Sep 28 17:57:39 devstack cinder-volume[75893]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 28 17:57:39 devstack cinder-volume[75893]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 28 17:57:39 devstack cinder-volume[75893]: we strongly recommend against using it for new projects.
Sep 28 17:57:39 devstack cinder-volume[75893]: If you are already using Eventlet, we recommend migrating to a different
Sep 28 17:57:39 devstack cinder-volume[75893]: framework.  For more detail see
Sep 28 17:57:39 devstack cinder-volume[75893]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 28 17:57:39 devstack cinder-volume[75893]:   import eventlet  # noqa
Sep 28 17:57:42 devstack cinder-volume[75893]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75893) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 28 17:57:42 devstack cinder-volume[75893]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75893) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 28 17:57:42 devstack cinder-volume[75893]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75893) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 28 17:57:43 devstack cinder-volume[75893]: INFO dbcounter [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Registered counter for database cinder
Sep 28 17:57:43 devstack cinder-volume[75893]: DEBUG oslo_db.sqlalchemy.engines [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75893) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 28 17:57:44 devstack cinder-volume[75893]: DEBUG dbcounter [-] [75893] Writer thread running {{(pid=75893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 28 17:57:44 devstack cinder-volume[75893]: INFO cinder.rpc [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 28 17:57:44 devstack cinder-volume[75893]: INFO cinder.rpc [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 28 17:57:44 devstack cinder-volume[75893]: DEBUG oslo_db.sqlalchemy.engines [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75893) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 28 17:57:44 devstack cinder-volume[75893]: INFO cinder.volume.manager [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Determined volume DB was empty at startup.
Sep 28 17:57:44 devstack cinder-volume[75893]: DEBUG cinder.volume.manager [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75893) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 28 17:57:44 devstack cinder-volume[75893]: INFO cinder.volume.manager [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 28 17:57:44 devstack cinder-volume[75893]: WARNING stevedore.named [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 28 17:57:44 devstack cinder-volume[75893]: WARNING castellan.key_manager [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 28 17:57:44 devstack cinder-volume[75893]: WARNING cinder.keymgr.conf_key_mgr [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 28 17:57:44 devstack cinder-volume[75893]: DEBUG cinder.volume.drivers.lvm [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75893) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 28 17:57:44 devstack cinder-volume[75893]: DEBUG oslo_concurrency.processutils [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:44 devstack cinder-volume[75893]: DEBUG oslo_concurrency.processutils [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] CMD "cinder-rtstool verify" returned: 0 in 0.500s {{(pid=75893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:44 devstack cinder-volume[75893]: DEBUG oslo_db.sqlalchemy.engines [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75893) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 28 17:57:44 devstack cinder-volume[75893]: INFO cinder.rpc [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 28 17:57:44 devstack cinder-volume[75893]: INFO cinder.rpc [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 28 17:57:44 devstack cinder-volume[75893]: WARNING stevedore.named [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 28 17:57:44 devstack cinder-volume[75893]: WARNING castellan.key_manager [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 28 17:57:44 devstack cinder-volume[75893]: INFO cinder.volume.manager [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 28 17:57:44 devstack cinder-volume[75893]: DEBUG oslo_db.sqlalchemy.engines [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75893) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 28 17:57:45 devstack cinder-volume[75893]: INFO oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Starting 1 workers
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Started child 76110 {{(pid=75893) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Full set of CONF: {{(pid=75893) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] ******************************************************************************** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Configuration options gathered from: {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] ================================================================================ {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] allow_availability_zone_fallback = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] allow_compression_on_image_upload = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] allowed_direct_url_schemes     = [] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] api_rate_limit                 = True {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] auth_strategy                  = keystone {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] az_cache_duration              = 3600 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_availability_zone      = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_host                   = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_name                   = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_stats_polling_interval = 60 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[76110]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0)
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backup_api_class               = cinder.backup.api.API {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backup_name_template           = backup-%s {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backup_use_same_host           = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backup_use_temp_snapshot       = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] chap_password                  = **** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] chap_username                  =  {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cinder_internal_tenant_project_id = 9392edb1ad474837a53f0a34904a5ff6 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cinder_internal_tenant_user_id = 2d2964ea9c444d2682d7f07dc295bac7 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cloned_volume_same_az          = True {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cluster                        = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] compression_format             = gzip {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] compute_api_class              = cinder.compute.nova.API {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] config_dir                     = [] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] config_source                  = [] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] control_exchange               = openstack {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] debug                          = True {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] default_availability_zone      = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] default_group_type             = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] default_volume_type            = lvmdriver-1 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] disk_geometry                  = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] driver_client_cert             = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] driver_client_cert_key         = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] driver_data_namespace          = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] driver_ssl_cert_path           = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] driver_ssl_cert_verify         = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] driver_use_ssl                 = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] enable_force_upload            = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] enable_new_services            = True {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] enable_unsupported_driver      = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] enforce_multipath_for_image_xfer = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] filter_function                = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] glance_api_insecure            = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] glance_api_servers             = ['http://192.168.122.2/image'] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] glance_api_ssl_compression     = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] glance_ca_certificates_file    = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] glance_catalog_info            = image:glance:publicURL {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] glance_certfile                = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] glance_keyfile                 = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] glance_num_retries             = 3 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] glance_request_timeout         = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] goodness_function              = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] graceful_shutdown_timeout      = 5 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] group_api_class                = cinder.group.api.API {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] host                           = devstack {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] image_compress_on_upload       = True {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] image_conversion_address_space_limit = 1 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] image_conversion_cpu_limit     = 60 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] image_conversion_disable       = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] image_introspection_address_space_limit = 1 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] image_introspection_cpu_limit  = 60 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] image_upload_use_cinder_backend = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] image_upload_use_internal_tenant = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] image_volume_cache_enabled     = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] image_volume_cache_max_count   = 0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] image_volume_cache_max_size_gb = 0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] init_host_max_objects_retrieval = 0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] instance_format                = [instance: %(uuid)s]  {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] iscsi_target_flags             =  {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] iscsi_write_cache              = on {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] iser_helper                    = tgtadm {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] iser_ip_address                = 192.168.122.2 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] iser_port                      = 3260 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] log_color                      = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] log_config_append              = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] log_dir                        = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] log_file                       = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] log_options                    = True {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] log_rotate_interval            = 1 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] log_rotate_interval_type       = days {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] log_rotation_type              = none {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] max_age                        = 0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] max_logfile_count              = 30 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] max_logfile_size_mb            = 200 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] max_over_subscription_ratio    = 20.0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] message_reap_interval          = 86400 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] message_ttl                    = 2592000 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] migration_create_volume_timeout_secs = 300 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] monkey_patch                   = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] monkey_patch_modules           = [] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] my_ip                          = 192.168.122.2 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] no_snapshot_gb_quota           = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] num_iser_scan_tries            = 3 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] num_shell_tries                = 3 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] num_volume_device_scan_tries   = 3 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] nvmeof_conn_info_version       = 1 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] nvmet_ns_id                    = 10 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] nvmet_port_id                  = 1 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] osapi_max_limit                = 1000 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] osapi_volume_ext_list          = [] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] osapi_volume_listen_port       = 8776 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] osapi_volume_use_ssl           = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] osapi_volume_workers           = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] per_volume_size_limit          = -1 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[76110]: INFO cinder.volume.manager [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] periodic_fuzzy_delay           = 60 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] periodic_interval              = 60 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] public_endpoint                = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] publish_errors                 = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] quota_backup_gigabytes         = 1000 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] quota_backups                  = 10 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] quota_gigabytes                = 1000 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] quota_groups                   = 10 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] quota_snapshots                = 10 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] quota_volumes                  = 10 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] rate_limit_burst               = 0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] rate_limit_except_level        = CRITICAL {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] rate_limit_interval            = 0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] reinit_driver_count            = 3 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] replication_device             = **** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] report_discard_supported       = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] report_interval                = 120 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] reservation_clean_interval     = 86400 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] reservation_expire             = 86400 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] reserved_image_namespaces      = [] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] reserved_percentage            = 0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] rpc_response_timeout           = 120 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] run_external_periodic_tasks    = True {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] scst_target_driver             = iscsi {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] scst_target_iqn_name           = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] service_down_time              = 720 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] shell_completion               = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] snapshot_name_template         = snapshot-%s {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] snapshot_same_host             = True {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] split_loggers                  = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] state_path                     = /opt/stack/data/cinder {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] storage_availability_zone      = nova {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] storage_protocol               = iSCSI {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] syslog_log_facility            = LOG_USER {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] target_helper                  = lioadm {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] target_ip_address              = 192.168.122.2 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] target_port                    = 3260 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] target_protocol                = iscsi {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] target_secondary_ip_addresses  = [] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] trace_flags                    = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] transport_url                  = **** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] until_refresh                  = 0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] use_chap_auth                  = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] use_default_quota_class        = True {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] use_journal                    = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] use_json                       = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] use_multipath_for_image_xfer   = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] use_stderr                     = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] use_syslog                     = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] verify_glance_signatures       = enabled {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] volume_api_class               = cinder.volume.api.API {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] volume_backend_name            = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] volume_clear                   = zero {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] volume_clear_ionice            = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] volume_clear_size              = 0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] volume_copy_bps_limit          = 0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] volume_dd_blocksize            = 1M {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] volume_name_template           = volume-%s {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] volume_service_inithost_offload = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] volume_usage_audit_period      = month {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] zoning_mode                    = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_concurrency.disable_process_locking = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.auth_section = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.auth_type   = password {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.auth_version = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.cache       = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.054s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.certfile    = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.delay_auth_decision = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.http_connect_timeout = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.include_service_catalog = True {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.insecure    = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.interface   = public {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.keyfile     = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.memcache_password = **** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.memcache_username = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.region_name = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.service_token_roles_required = True {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.service_type = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.token_cache_time = 300 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.2/identity {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.backend                  = dogpile.cache.null {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.backend_argument         = **** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.backend_expiration_time  = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.config_prefix            = cache.oslo {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.debug_cache_backend      = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.enable_retry_client      = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.enable_socket_keepalive  = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.enabled                  = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.expiration_time          = 600 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.hashclient_retry_attempts = 2 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.memcache_dead_retry      = 300 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.memcache_pool_maxsize    = 10 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.memcache_sasl_enabled    = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.password                 = **** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.proxies                  = [] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.redis_db                 = 0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.redis_sentinel_service_name = mymaster {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.redis_server             = localhost:6379 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.retry_attempts           = 2 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.retry_delay              = 0.0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.socket_keepalive_count   = 1 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.socket_keepalive_idle    = 1 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.socket_keepalive_interval = 1 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.socket_timeout           = 1.0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.tls_allowed_ciphers      = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.tls_cafile               = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.tls_certfile             = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.tls_enabled              = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.tls_keyfile              = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cache.username                 = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] coordination.backend_url       = **** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.asyncio_connection    = **** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.asyncio_slave_connection = **** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.backend               = sqlalchemy {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.connection            = **** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.connection_debug      = 0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.connection_parameters =  {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.connection_recycle_time = 3600 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.connection_trace      = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.db_inc_retry_interval = True {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.db_max_retries        = 20 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.db_max_retry_interval = 10 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.db_retry_interval     = 1 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.max_overflow          = 50 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.max_pool_size         = 5 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.max_retries           = 10 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.mysql_wsrep_sync_wait = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.pool_timeout          = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.retry_interval        = 10 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.slave_connection      = **** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.sqlite_synchronous    = True {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.synchronous_reader    = True {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] database.use_db_reconnect      = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:45 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_tracing.insecure = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] profiler.connection_string     = messaging:// {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] profiler.enabled               = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] profiler.es_doc_type           = notification {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] profiler.es_scroll_size        = 10000 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] profiler.es_scroll_time        = 2m {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] profiler.filter_error_trace    = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] profiler.hmac_keys             = **** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] profiler.sentinel_service_name = mymaster {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] profiler.socket_timeout        = 0.1 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] profiler.trace_requests        = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] profiler.trace_sqlalchemy      = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] profiler_jaeger.process_tags   = {} {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] profiler_jaeger.service_name_prefix = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] profiler_otlp.service_name_prefix = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_policy.enforce_new_defaults = True {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_policy.policy_default_rule = default {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_policy.policy_file        = policy.yaml {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] privsep_osbrick.group          = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] privsep_osbrick.helper_command = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] privsep_osbrick.user           = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cinder_sys_admin.group         = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cinder_sys_admin.helper_command = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] cinder_sys_admin.user          = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] service_user.auth_section      = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] service_user.auth_type         = password {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] service_user.cafile            = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] service_user.certfile          = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] service_user.collect_timing    = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] service_user.insecure          = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] service_user.keyfile           = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] service_user.send_service_user_token = True {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] service_user.split_loggers     = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] service_user.timeout           = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] service_user.tls_ciphers       = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] service_user.tls_min_version   = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] glance.auth_section            = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] glance.auth_type               = password {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] glance.certfile                = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] glance.collect_timing          = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] glance.insecure                = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] glance.keyfile                 = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] glance.region_name             = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] glance.split_loggers           = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] glance.timeout                 = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] glance.tls_ciphers             = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] glance.tls_min_version         = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.backend_availability_zone = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.chap_password = **** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.chap_username =  {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.disk_geometry = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.driver_client_cert = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.driver_client_cert_key = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.driver_data_namespace = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.driver_use_ssl = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.enable_unsupported_driver = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.extra_capabilities = {} {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.filter_function = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.goodness_function = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack sudo[76185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 28 17:57:45 devstack sudo[76185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.iscsi_target_flags =  {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.iscsi_write_cache = on {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.iser_helper   = tgtadm {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.iser_ip_address = 192.168.122.2 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.iser_port     = 3260 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.lvm_share_target = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.lvm_type      = auto {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.num_shell_tries = 3 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.nvmet_port_id = 1 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.replication_device = **** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.report_discard_supported = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.reserved_percentage = 0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.scst_target_driver = iscsi {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.scst_target_iqn_name = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.storage_protocol = iSCSI {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.target_helper = tgtadm {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.target_ip_address = 192.168.122.2 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.target_port   = 3260 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.target_protocol = iscsi {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.trace_flags   = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.unique_fqdn_network = True {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.use_chap_auth = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.volume_backend_name = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.volume_clear  = zero {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.volume_clear_ionice = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.volume_clear_size = 0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_reports.file_event_handler = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_reports.log_dir           = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.backend_availability_zone = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.backend_host       = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.chap_password      = **** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.chap_username      = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.disk_geometry      = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.driver_client_cert = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.driver_data_namespace = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.extra_capabilities = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.filter_function    = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.goodness_function  = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.iser_helper        = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.iser_ip_address    = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.iser_port          = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.iser_target_prefix = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.lvm_share_target   = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.lvm_type           = auto {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.num_shell_tries    = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.replication_device = **** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.report_discard_supported = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.reserved_percentage = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.scst_target_driver = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.storage_protocol   = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.target_helper      = lioadm {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.target_ip_address  = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.target_port        = 3260 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.trace_flags        = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.use_chap_auth      = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.volume_clear       = zero {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.volume_clear_size  = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] lvmdriver-1.volumes_dir        = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.ssl      = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_notifications.driver = [] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_notifications.retry = -1 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] oslo_messaging_notifications.transport_url = **** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] key_manager.fixed_key          = **** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican.barbican_api_version  = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican.barbican_endpoint     = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican.barbican_endpoint_type = public {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican.barbican_region_name  = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican.cafile                = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican.certfile              = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican.collect_timing        = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican.insecure              = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican.keyfile               = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican.number_of_retries     = 60 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican.retry_delay           = 1 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican.send_service_user_token = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican.split_loggers         = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican.timeout               = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican.tls_ciphers           = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican.tls_min_version       = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican.verify_ssl            = True {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican.verify_ssl_path       = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican_service_user.auth_section = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican_service_user.auth_type = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican_service_user.cafile   = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican_service_user.certfile = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican_service_user.collect_timing = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican_service_user.insecure = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican_service_user.keyfile  = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican_service_user.split_loggers = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican_service_user.timeout  = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican_service_user.tls_ciphers = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] barbican_service_user.tls_min_version = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] vault.approle_role_id          = **** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] vault.approle_secret_id        = **** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] vault.auth_method              = approle {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] vault.auth_path                = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] vault.kv_mountpoint            = secret {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] vault.kv_path                  = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] vault.kv_version               = 2 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] vault.namespace                = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] vault.root_token_id            = **** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] vault.ssl_ca_crt_file          = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] vault.timeout                  = 60.0 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] vault.token_file               = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] vault.token_role               = None {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] vault.use_ssl                  = False {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 17:57:45 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] ******************************************************************************** {{(pid=75893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 28 17:57:45 devstack sudo[76185]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:45 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.364s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:45 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:45 devstack sudo[76277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 28 17:57:45 devstack sudo[76277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:45 devstack sudo[76277]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:45 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.273s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:45 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 17:57:45 devstack cinder-volume[76110]: INFO cinder.brick.local_dev.lvm [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 28 17:57:45 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:45 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:45 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:45 devstack sudo[76374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 28 17:57:45 devstack sudo[76374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:46 devstack sudo[76374]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:46 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:46 devstack cinder-volume[76110]: DEBUG cinder.brick.local_dev.lvm [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76110) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 28 17:57:46 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:46 devstack sudo[76458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 28 17:57:46 devstack sudo[76458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:47 devstack sudo[76458]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:48 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.785s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:48 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:48 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:48 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:48 devstack sudo[76749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 28 17:57:48 devstack sudo[76749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:48 devstack sudo[76749]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:48 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.358s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:48 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:48 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:48 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:48 devstack sudo[76829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 28 17:57:48 devstack sudo[76829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:48 devstack sudo[76829]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:48 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.322s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:48 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:48 devstack sudo[76832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 28 17:57:48 devstack sudo[76832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:49 devstack sudo[76832]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:49 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.323s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:49 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:49 devstack sudo[76835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 28 17:57:49 devstack sudo[76835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:49 devstack sudo[76835]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:49 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.325s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:49 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:49 devstack sudo[76838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 28 17:57:49 devstack sudo[76838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:49 devstack sudo[76838]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:49 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.328s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:49 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:49 devstack sudo[76841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 28 17:57:49 devstack sudo[76841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:50 devstack sudo[76841]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:50 devstack sudo[76845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 28 17:57:50 devstack sudo[76845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:50 devstack sudo[76845]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.341s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:50 devstack cinder-volume[76110]: INFO cinder.volume.drivers.lvm [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 28 17:57:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:50 devstack sudo[76850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 28 17:57:50 devstack sudo[76850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:50 devstack sudo[76850]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.303s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:50 devstack cinder-volume[76110]: DEBUG cinder.volume.drivers.lvm [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Updating volume stats {{(pid=76110) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 28 17:57:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:50 devstack sudo[76854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 28 17:57:50 devstack sudo[76854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:51 devstack sudo[76854]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:51 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:51 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:51 devstack sudo[76858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 28 17:57:51 devstack sudo[76858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:51 devstack sudo[76858]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:51 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:51 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:51 devstack sudo[76861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 28 17:57:51 devstack sudo[76861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:51 devstack sudo[76861]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:51 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.319s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:51 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:51 devstack sudo[76865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 28 17:57:51 devstack sudo[76865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:51 devstack sudo[76865]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:51 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.350s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:51 devstack cinder-volume[76110]: INFO cinder.volume.driver [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Driver hasn't implemented _init_vendor_properties()
Sep 28 17:57:51 devstack cinder-volume[76110]: DEBUG cinder.volume.driver [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76110) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 28 17:57:52 devstack cinder-volume[76110]: DEBUG oslo_db.sqlalchemy.engines [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76110) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 28 17:57:52 devstack cinder-volume[76110]: DEBUG dbcounter [-] [76110] Writer thread running {{(pid=76110) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 28 17:57:52 devstack cinder-volume[76110]: DEBUG cinder.db.api [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Building query based on filter {{(pid=76110) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 28 17:57:52 devstack cinder-volume[76110]: DEBUG cinder.image.image_utils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76110) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 28 17:57:52 devstack cinder-volume[76110]: INFO cinder.keymgr.migration [None req-3094867d-d093-4bb5-9d2b-62f6e2c7fc76 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 28 17:57:52 devstack cinder-volume[76110]: DEBUG cinder.volume.drivers.lvm [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Updating volume stats {{(pid=76110) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 28 17:57:52 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:52 devstack sudo[76874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 28 17:57:52 devstack sudo[76874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:52 devstack sudo[76874]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:52 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:52 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:52 devstack sudo[76878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 28 17:57:52 devstack sudo[76878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:52 devstack sudo[76878]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:52 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:52 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:52 devstack sudo[76881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 28 17:57:52 devstack sudo[76881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:53 devstack sudo[76881]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:53 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:53 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:53 devstack sudo[76884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 28 17:57:53 devstack sudo[76884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:53 devstack sudo[76884]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:53 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:53 devstack cinder-volume[76110]: DEBUG cinder.manager [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Notifying Schedulers of capabilities ... {{(pid=76110) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 17:57:53 devstack cinder-volume[76110]: INFO cinder.volume.manager [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Driver initialization completed successfully.
Sep 28 17:57:53 devstack cinder-volume[76110]: INFO cinder.manager [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Initiating service 2 cleanup
Sep 28 17:57:53 devstack cinder-volume[76110]: INFO cinder.manager [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Service 2 cleanup completed.
Sep 28 17:57:53 devstack cinder-volume[76110]: DEBUG cinder.service [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Creating RPC server for service cinder-volume {{(pid=76110) start /opt/stack/cinder/cinder/service.py:231}}
Sep 28 17:57:53 devstack cinder-volume[76110]: DEBUG cinder.service [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76110) start /opt/stack/cinder/cinder/service.py:237}}
Sep 28 17:57:53 devstack cinder-volume[76110]: INFO cinder.volume.manager [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 28 17:57:53 devstack cinder-volume[76110]: DEBUG cinder.volume.drivers.lvm [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Updating volume stats {{(pid=76110) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 28 17:57:53 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:53 devstack sudo[76887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 28 17:57:53 devstack sudo[76887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:53 devstack sudo[76887]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:53 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.368s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:53 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:53 devstack sudo[76893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 28 17:57:53 devstack sudo[76893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:54 devstack sudo[76893]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:54 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.333s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:54 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:54 devstack sudo[76900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 28 17:57:54 devstack sudo[76900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:54 devstack sudo[76900]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:54 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.362s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:54 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:57:54 devstack sudo[76923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 28 17:57:54 devstack sudo[76923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:57:54 devstack sudo[76923]: pam_unix(sudo:session): session closed for user root
Sep 28 17:57:54 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:57:54 devstack cinder-volume[76110]: INFO cinder.volume.manager [None req-52e571ca-e824-445e-bb03-a782f26f685d None None] Driver post RPC initialization completed successfully.
Sep 28 17:57:54 devstack cinder-volume[75893]: DEBUG dbcounter [-] [75893] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 17:58:03 devstack cinder-volume[76110]: DEBUG dbcounter [-] [76110] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76110) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 17:58:04 devstack cinder-volume[76110]: DEBUG dbcounter [-] [76110] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=76110) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 17:58:49 devstack cinder-volume[76110]: DEBUG oslo_service.periodic_task [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76110) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 17:58:49 devstack cinder-volume[76110]: DEBUG cinder.volume.drivers.lvm [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Updating volume stats {{(pid=76110) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 28 17:58:49 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:58:49 devstack sudo[78787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 28 17:58:49 devstack sudo[78787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:58:50 devstack sudo[78787]: pam_unix(sudo:session): session closed for user root
Sep 28 17:58:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:58:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:58:50 devstack sudo[78790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 28 17:58:50 devstack sudo[78790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:58:50 devstack sudo[78790]: pam_unix(sudo:session): session closed for user root
Sep 28 17:58:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:58:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:58:50 devstack sudo[78793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 28 17:58:50 devstack sudo[78793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:58:50 devstack sudo[78793]: pam_unix(sudo:session): session closed for user root
Sep 28 17:58:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.314s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:58:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:58:50 devstack sudo[78796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 28 17:58:50 devstack sudo[78796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:58:51 devstack sudo[78796]: pam_unix(sudo:session): session closed for user root
Sep 28 17:58:51 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.344s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:58:51 devstack cinder-volume[76110]: DEBUG cinder.manager [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Notifying Schedulers of capabilities ... {{(pid=76110) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 17:58:51 devstack cinder-volume[76110]: DEBUG oslo_service.periodic_task [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running periodic task VolumeManager._thread_info {{(pid=76110) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 17:58:51 devstack cinder-volume[76110]: DEBUG cinder.volume.manager [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] thread count: 6 {{(pid=76110) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 17:58:51 devstack cinder-volume[76110]: DEBUG cinder.volume.manager [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] thread info: [<_MainThread(MainThread, started 134538173788288)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134538070196608)>, <Thread(Thread-3 (stat_writer), started daemon 134538059289472)>, <Thread(Rabbit-heartbeat, started daemon 134538058632000)>, <Thread(Thread-5 (_runner), started daemon 134538058681856)>, <Thread(Thread-7 (_runner), started daemon 134538056768320)>] {{(pid=76110) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 17:59:49 devstack cinder-volume[76110]: DEBUG oslo_service.periodic_task [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76110) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 17:59:49 devstack cinder-volume[76110]: DEBUG cinder.volume.drivers.lvm [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Updating volume stats {{(pid=76110) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 28 17:59:49 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:59:49 devstack sudo[82056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 28 17:59:49 devstack sudo[82056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:59:50 devstack sudo[82056]: pam_unix(sudo:session): session closed for user root
Sep 28 17:59:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:59:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:59:50 devstack sudo[82060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 28 17:59:50 devstack sudo[82060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:59:50 devstack sudo[82060]: pam_unix(sudo:session): session closed for user root
Sep 28 17:59:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:59:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:59:50 devstack sudo[82064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 28 17:59:50 devstack sudo[82064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:59:50 devstack sudo[82064]: pam_unix(sudo:session): session closed for user root
Sep 28 17:59:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:59:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 17:59:50 devstack sudo[82068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 28 17:59:50 devstack sudo[82068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 17:59:51 devstack sudo[82068]: pam_unix(sudo:session): session closed for user root
Sep 28 17:59:51 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 17:59:51 devstack cinder-volume[76110]: DEBUG cinder.manager [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Notifying Schedulers of capabilities ... {{(pid=76110) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:00:04 devstack cinder-volume[76110]: DEBUG dbcounter [-] [76110] Writing DB stats cinder:SELECT=1 {{(pid=76110) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:00:04 devstack cinder-volume[76110]: DEBUG dbcounter [-] [76110] Writing DB stats cinder:UPDATE=1 {{(pid=76110) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:00:49 devstack cinder-volume[76110]: DEBUG oslo_service.periodic_task [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76110) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:00:49 devstack cinder-volume[76110]: DEBUG cinder.volume.drivers.lvm [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Updating volume stats {{(pid=76110) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 28 18:00:49 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:00:49 devstack sudo[83855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 28 18:00:49 devstack sudo[83855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:00:50 devstack sudo[83855]: pam_unix(sudo:session): session closed for user root
Sep 28 18:00:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:00:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:00:50 devstack sudo[83863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 28 18:00:50 devstack sudo[83863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:00:50 devstack sudo[83863]: pam_unix(sudo:session): session closed for user root
Sep 28 18:00:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:00:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:00:50 devstack sudo[83871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 28 18:00:50 devstack sudo[83871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:00:50 devstack sudo[83871]: pam_unix(sudo:session): session closed for user root
Sep 28 18:00:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:00:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:00:50 devstack sudo[83880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 28 18:00:50 devstack sudo[83880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:00:51 devstack sudo[83880]: pam_unix(sudo:session): session closed for user root
Sep 28 18:00:51 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:00:51 devstack cinder-volume[76110]: DEBUG cinder.manager [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Notifying Schedulers of capabilities ... {{(pid=76110) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:00:51 devstack cinder-volume[76110]: DEBUG oslo_service.periodic_task [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running periodic task VolumeManager._thread_info {{(pid=76110) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:00:51 devstack cinder-volume[76110]: DEBUG cinder.volume.manager [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] thread count: 6 {{(pid=76110) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:00:51 devstack cinder-volume[76110]: DEBUG cinder.volume.manager [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] thread info: [<_MainThread(MainThread, started 134538173788288)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134538070196608)>, <Thread(Thread-3 (stat_writer), started daemon 134538059289472)>, <Thread(Rabbit-heartbeat, started daemon 134538058632000)>, <Thread(Thread-5 (_runner), started daemon 134538058681856)>, <Thread(Thread-7 (_runner), started daemon 134538056768320)>] {{(pid=76110) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:01:49 devstack cinder-volume[76110]: DEBUG oslo_service.periodic_task [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76110) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:01:49 devstack cinder-volume[76110]: DEBUG cinder.volume.drivers.lvm [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Updating volume stats {{(pid=76110) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 28 18:01:49 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:01:49 devstack sudo[85152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 28 18:01:49 devstack sudo[85152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:01:50 devstack sudo[85152]: pam_unix(sudo:session): session closed for user root
Sep 28 18:01:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:01:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:01:50 devstack sudo[85159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 28 18:01:50 devstack sudo[85159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:01:50 devstack sudo[85159]: pam_unix(sudo:session): session closed for user root
Sep 28 18:01:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:01:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:01:50 devstack sudo[85162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 28 18:01:50 devstack sudo[85162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:01:50 devstack sudo[85162]: pam_unix(sudo:session): session closed for user root
Sep 28 18:01:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.315s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:01:50 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:01:50 devstack sudo[85165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 28 18:01:50 devstack sudo[85165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:01:51 devstack sudo[85165]: pam_unix(sudo:session): session closed for user root
Sep 28 18:01:51 devstack cinder-volume[76110]: DEBUG oslo_concurrency.processutils [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:01:51 devstack cinder-volume[76110]: DEBUG cinder.manager [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Notifying Schedulers of capabilities ... {{(pid=76110) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:01:51 devstack cinder-volume[76110]: DEBUG oslo_service.periodic_task [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] Running periodic task VolumeManager._thread_info {{(pid=76110) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:01:51 devstack cinder-volume[76110]: DEBUG cinder.volume.manager [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] thread count: 6 {{(pid=76110) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:01:51 devstack cinder-volume[76110]: DEBUG cinder.volume.manager [None req-73c6d8e4-b10e-4b64-b88a-97b203945732 None None] thread info: [<_MainThread(MainThread, started 134538173788288)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134538070196608)>, <Thread(Thread-3 (stat_writer), started daemon 134538059289472)>, <Thread(Rabbit-heartbeat, started daemon 134538058632000)>, <Thread(Thread-5 (_runner), started daemon 134538058681856)>, <Thread(Thread-7 (_runner), started daemon 134538056768320)>] {{(pid=76110) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:02:04 devstack cinder-volume[76110]: DEBUG dbcounter [-] [76110] Writing DB stats cinder:SELECT=1 {{(pid=76110) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:02:04 devstack cinder-volume[76110]: DEBUG dbcounter [-] [76110] Writing DB stats cinder:UPDATE=1 {{(pid=76110) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:02:32 devstack cinder-volume[75893]: INFO oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Caught SIGTERM, stopping children
Sep 28 18:02:32 devstack cinder-volume[75893]: DEBUG oslo_concurrency.lockutils [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Acquiring lock "singleton_lock" {{(pid=75893) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 28 18:02:32 devstack cinder-volume[75893]: DEBUG oslo_concurrency.lockutils [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Acquired lock "singleton_lock" {{(pid=75893) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 28 18:02:32 devstack cinder-volume[75893]: DEBUG oslo_concurrency.lockutils [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Releasing lock "singleton_lock" {{(pid=75893) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 28 18:02:32 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Stop services. {{(pid=75893) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 28 18:02:32 devstack cinder-volume[75893]: DEBUG oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Killing children. {{(pid=75893) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 28 18:02:32 devstack cinder-volume[75893]: INFO oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Waiting on 1 children to exit
Sep 28 18:02:33 devstack cinder-volume[76110]: DEBUG oslo_concurrency.lockutils [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Acquiring lock "singleton_lock" {{(pid=76110) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 28 18:02:33 devstack cinder-volume[76110]: DEBUG oslo_concurrency.lockutils [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Acquired lock "singleton_lock" {{(pid=76110) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 28 18:02:33 devstack cinder-volume[76110]: DEBUG oslo_concurrency.lockutils [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Releasing lock "singleton_lock" {{(pid=76110) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 28 18:02:33 devstack cinder-volume[76110]: WARNING amqp [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 28 18:02:33 devstack cinder-volume[76110]: WARNING amqp [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 28 18:02:33 devstack cinder-volume[75893]: INFO oslo_service.backend._eventlet.service [None req-df6bad94-5c70-4fb0-836d-388591977e8f None None] Child 76110 exited with status 0
Sep 28 18:02:33 devstack cinder-volume[86109]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 28 18:02:33 devstack cinder-volume[86109]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 28 18:02:33 devstack cinder-volume[86109]: we strongly recommend against using it for new projects.
Sep 28 18:02:33 devstack cinder-volume[86109]: If you are already using Eventlet, we recommend migrating to a different
Sep 28 18:02:33 devstack cinder-volume[86109]: framework.  For more detail see
Sep 28 18:02:33 devstack cinder-volume[86109]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 28 18:02:33 devstack cinder-volume[86109]:   import eventlet  # noqa
Sep 28 18:02:36 devstack cinder-volume[86109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86109) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 28 18:02:36 devstack cinder-volume[86109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86109) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 28 18:02:36 devstack cinder-volume[86109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86109) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 28 18:02:37 devstack cinder-volume[86109]: INFO dbcounter [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Registered counter for database cinder
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_db.sqlalchemy.engines [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86109) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG dbcounter [-] [86109] Writer thread running {{(pid=86109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 28 18:02:37 devstack cinder-volume[86109]: INFO cinder.rpc [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 28 18:02:37 devstack cinder-volume[86109]: INFO cinder.rpc [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_db.sqlalchemy.engines [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86109) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 28 18:02:37 devstack cinder-volume[86109]: INFO cinder.volume.manager [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Determined volume DB was empty at startup.
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG cinder.volume.manager [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86109) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 28 18:02:37 devstack cinder-volume[86109]: INFO cinder.volume.manager [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 28 18:02:37 devstack cinder-volume[86109]: WARNING stevedore.named [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 28 18:02:37 devstack cinder-volume[86109]: WARNING castellan.key_manager [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 28 18:02:37 devstack cinder-volume[86109]: WARNING cinder.keymgr.conf_key_mgr [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 28 18:02:37 devstack cinder-volume[86109]: INFO cinder.volume.manager [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_db.sqlalchemy.engines [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86109) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 28 18:02:37 devstack cinder-volume[86109]: INFO oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Starting 1 workers
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Started child 86393 {{(pid=86109) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Full set of CONF: {{(pid=86109) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] ******************************************************************************** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Configuration options gathered from: {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] ================================================================================ {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] allow_availability_zone_fallback = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] allow_compression_on_image_upload = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] allowed_direct_url_schemes     = [] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] api_rate_limit                 = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] auth_strategy                  = keystone {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_availability_zone      = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_host                   = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_name                   = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_stats_polling_interval = 60 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backup_api_class               = cinder.backup.api.API {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backup_name_template           = backup-%s {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backup_use_same_host           = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86393]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0)
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backup_use_temp_snapshot       = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] chap_password                  = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] chap_username                  =  {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cinder_internal_tenant_project_id = 9392edb1ad474837a53f0a34904a5ff6 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cinder_internal_tenant_user_id = 2d2964ea9c444d2682d7f07dc295bac7 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cluster                        = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] compression_format             = gzip {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] config_dir                     = [] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] config_source                  = [] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] control_exchange               = openstack {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] debug                          = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] default_availability_zone      = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] default_group_type             = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] default_volume_type            = QuobyteHD {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] disk_geometry                  = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] driver_client_cert             = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] driver_client_cert_key         = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] driver_data_namespace          = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] driver_ssl_cert_path           = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] driver_ssl_cert_verify         = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] driver_use_ssl                 = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] enable_new_services            = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] enable_unsupported_driver      = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] enforce_multipath_for_image_xfer = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] filter_function                = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] glance_api_insecure            = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] glance_api_servers             = ['http://192.168.122.2/image'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] glance_api_ssl_compression     = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] glance_ca_certificates_file    = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] glance_certfile                = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] glance_keyfile                 = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] glance_num_retries             = 3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] glance_request_timeout         = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] goodness_function              = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] graceful_shutdown_timeout      = 5 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] group_api_class                = cinder.group.api.API {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] host                           = devstack {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] image_compress_on_upload       = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] image_conversion_address_space_limit = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] image_conversion_cpu_limit     = 60 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] image_conversion_disable       = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] image_introspection_address_space_limit = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] image_introspection_cpu_limit  = 60 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] image_upload_use_cinder_backend = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:37 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] image_upload_use_internal_tenant = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] image_volume_cache_enabled     = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] image_volume_cache_max_count   = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] image_volume_cache_max_size_gb = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] init_host_max_objects_retrieval = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] iscsi_target_flags             =  {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] iscsi_write_cache              = on {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] iser_helper                    = tgtadm {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] iser_ip_address                = 192.168.122.2 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] iser_port                      = 3260 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] log_color                      = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] log_config_append              = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] log_dir                        = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] log_file                       = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] log_options                    = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] log_rotate_interval            = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] log_rotate_interval_type       = days {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] log_rotation_type              = none {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] max_age                        = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] max_logfile_count              = 30 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] max_logfile_size_mb            = 200 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] max_over_subscription_ratio    = 20.0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] message_reap_interval          = 86400 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] message_ttl                    = 2592000 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] migration_create_volume_timeout_secs = 300 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] monkey_patch                   = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] monkey_patch_modules           = [] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] my_ip                          = 192.168.122.2 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] no_snapshot_gb_quota           = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] num_iser_scan_tries            = 3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] num_shell_tries                = 3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] num_volume_device_scan_tries   = 3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] nvmeof_conn_info_version       = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] nvmet_ns_id                    = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] nvmet_port_id                  = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] osapi_max_limit                = 1000 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] osapi_volume_ext_list          = [] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] osapi_volume_listen_port       = 8776 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] osapi_volume_use_ssl           = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] osapi_volume_workers           = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] per_volume_size_limit          = -1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] periodic_fuzzy_delay           = 60 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] periodic_interval              = 60 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] public_endpoint                = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] publish_errors                 = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] quota_backup_gigabytes         = 1000 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] quota_backups                  = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] quota_gigabytes                = 1000 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] quota_groups                   = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] quota_snapshots                = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] quota_volumes                  = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] rate_limit_burst               = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] rate_limit_except_level        = CRITICAL {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] rate_limit_interval            = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] reinit_driver_count            = 3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] replication_device             = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] report_discard_supported       = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] report_interval                = 120 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] reservation_clean_interval     = 86400 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] reservation_expire             = 86400 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] reserved_image_namespaces      = [] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] reserved_percentage            = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] rpc_response_timeout           = 120 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] run_external_periodic_tasks    = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] scst_target_driver             = iscsi {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] scst_target_iqn_name           = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] service_down_time              = 720 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] shell_completion               = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] snapshot_name_template         = snapshot-%s {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] split_loggers                  = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] state_path                     = /opt/stack/data/cinder {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] storage_availability_zone      = nova {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] storage_protocol               = iSCSI {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] syslog_log_facility            = LOG_USER {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] target_helper                  = lioadm {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] target_ip_address              = 192.168.122.2 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] target_port                    = 3260 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] target_protocol                = iscsi {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] target_secondary_ip_addresses  = [] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] trace_flags                    = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] transport_url                  = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] until_refresh                  = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] use_chap_auth                  = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] use_default_quota_class        = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] use_journal                    = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] use_json                       = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] use_multipath_for_image_xfer   = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] use_stderr                     = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] use_syslog                     = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] verify_glance_signatures       = enabled {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] volume_api_class               = cinder.volume.api.API {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] volume_backend_name            = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] volume_clear                   = zero {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] volume_clear_ionice            = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] volume_clear_size              = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] volume_copy_bps_limit          = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] volume_dd_blocksize            = 1M {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] volume_name_template           = volume-%s {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] volume_service_inithost_offload = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] volume_usage_audit_period      = month {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] zoning_mode                    = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_concurrency.disable_process_locking = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.auth_section = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.auth_type   = password {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.auth_version = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.cache       = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.certfile    = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.include_service_catalog = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.insecure    = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.interface   = public {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.keyfile     = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.memcache_password = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86393]: INFO cinder.volume.manager [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86393]: DEBUG cinder.volume.drivers.remotefs [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86393) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.memcache_username = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.region_name = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.service_type = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.2/identity {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.backend                  = dogpile.cache.null {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.backend_argument         = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.backend_expiration_time  = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.config_prefix            = cache.oslo {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.debug_cache_backend      = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.enable_retry_client      = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.enable_socket_keepalive  = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.enabled                  = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.expiration_time          = 600 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.hashclient_retry_attempts = 2 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.memcache_dead_retry      = 300 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.memcache_sasl_enabled    = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.password                 = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.proxies                  = [] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.redis_db                 = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.redis_server             = localhost:6379 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.retry_attempts           = 2 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.retry_delay              = 0.0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.socket_keepalive_count   = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.socket_keepalive_idle    = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.socket_keepalive_interval = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.socket_timeout           = 1.0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.tls_allowed_ciphers      = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.tls_cafile               = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.tls_certfile             = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.tls_enabled              = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.tls_keyfile              = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cache.username                 = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] coordination.backend_url       = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.asyncio_connection    = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.asyncio_slave_connection = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.backend               = sqlalchemy {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.connection            = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.connection_debug      = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.connection_parameters =  {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.connection_recycle_time = 3600 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.connection_trace      = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.db_inc_retry_interval = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.db_max_retries        = 20 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.db_max_retry_interval = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.db_retry_interval     = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.max_overflow          = 50 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.max_pool_size         = 5 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.max_retries           = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.mysql_wsrep_sync_wait = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.pool_timeout          = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.retry_interval        = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.slave_connection      = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.sqlite_synchronous    = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.synchronous_reader    = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] database.use_db_reconnect      = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_tracing.insecure = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] profiler.connection_string     = messaging:// {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] profiler.enabled               = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] profiler.es_doc_type           = notification {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] profiler.es_scroll_size        = 10000 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] profiler.es_scroll_time        = 2m {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] profiler.filter_error_trace    = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] profiler.hmac_keys             = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] profiler.sentinel_service_name = mymaster {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] profiler.socket_timeout        = 0.1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] profiler.trace_requests        = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] profiler.trace_sqlalchemy      = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] profiler_jaeger.process_tags   = {} {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] profiler_jaeger.service_name_prefix = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] profiler_otlp.service_name_prefix = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_policy.enforce_new_defaults = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_policy.policy_default_rule = default {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] privsep_osbrick.group          = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] privsep_osbrick.helper_command = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] privsep_osbrick.user           = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cinder_sys_admin.group         = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cinder_sys_admin.helper_command = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] cinder_sys_admin.user          = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] service_user.auth_section      = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] service_user.auth_type         = password {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] service_user.cafile            = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] service_user.certfile          = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] service_user.collect_timing    = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] service_user.insecure          = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] service_user.keyfile           = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] service_user.send_service_user_token = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] service_user.split_loggers     = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] service_user.timeout           = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] service_user.tls_ciphers       = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] service_user.tls_min_version   = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] glance.auth_section            = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] glance.auth_type               = password {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] glance.certfile                = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] glance.collect_timing          = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] glance.insecure                = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] glance.keyfile                 = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] glance.region_name             = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] glance.split_loggers           = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] glance.timeout                 = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] glance.tls_ciphers             = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] glance.tls_min_version         = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.backend_availability_zone = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.chap_password = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.chap_username =  {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.disk_geometry = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.driver_client_cert = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.driver_client_cert_key = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.driver_data_namespace = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.driver_use_ssl = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.extra_capabilities = {} {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.filter_function = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.goodness_function = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.iscsi_target_flags =  {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.iscsi_write_cache = on {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.iser_ip_address = 192.168.122.2 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.iser_port     = 3260 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.nas_host      =  {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.nas_login     = admin {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.nas_mount_options = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.nas_password  = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.nas_private_key =  {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.nas_share_path =  {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.num_shell_tries = 3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.quobyte_volume_url = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.replication_device = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.report_discard_supported = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.reserved_percentage = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.target_helper = tgtadm {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.target_ip_address = 192.168.122.2 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.target_port   = 3260 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.target_protocol = iscsi {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.trace_flags   = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.unique_fqdn_network = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.use_chap_auth = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.volume_backend_name = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.volume_clear  = zero {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.volume_clear_ionice = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.volume_clear_size = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_reports.file_event_handler = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_reports.log_dir           = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.backend_availability_zone = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.backend_host         = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.chap_password        = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.chap_username        = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.disk_geometry        = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.driver_client_cert   = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.driver_data_namespace = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.extra_capabilities   = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.filter_function      = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.goodness_function    = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.iser_helper          = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.iser_ip_address      = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.iser_port            = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.nas_host             = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.nas_login            = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.nas_mount_options    = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.nas_password         = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.nas_private_key      = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.nas_share_path       = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.num_shell_tries      = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.replication_device   = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.report_discard_supported = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.reserved_percentage  = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.scst_target_driver   = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.storage_protocol     = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.target_helper        = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.target_ip_address    = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.target_port          = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.target_prefix        = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.target_protocol      = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.trace_flags          = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.use_chap_auth        = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.volume_clear         = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.volume_clear_size    = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] QuobyteHD.volumes_dir          = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86393]: DEBUG cinder.volume.drivers.quobyte [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86393) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86393]: WARNING cinder.volume.drivers.quobyte [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 28 18:02:38 devstack cinder-volume[86393]: WARNING cinder.volume.drivers.quobyte [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86393]: DEBUG oslo_concurrency.processutils [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Running cmd (subprocess): mount.quobyte {{(pid=86393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_notifications.driver = [] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_notifications.retry = -1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] key_manager.fixed_key          = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican.barbican_api_version  = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican.barbican_endpoint     = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican.barbican_endpoint_type = public {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican.barbican_region_name  = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican.cafile                = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican.certfile              = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican.collect_timing        = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican.insecure              = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican.keyfile               = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican.number_of_retries     = 60 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican.retry_delay           = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican.send_service_user_token = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican.split_loggers         = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican.timeout               = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican.tls_ciphers           = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican.tls_min_version       = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican.verify_ssl            = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican.verify_ssl_path       = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican_service_user.auth_section = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican_service_user.auth_type = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican_service_user.cafile   = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican_service_user.certfile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican_service_user.collect_timing = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican_service_user.insecure = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican_service_user.keyfile  = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican_service_user.split_loggers = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican_service_user.timeout  = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican_service_user.tls_ciphers = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] barbican_service_user.tls_min_version = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] vault.approle_role_id          = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] vault.approle_secret_id        = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] vault.auth_method              = approle {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] vault.auth_path                = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] vault.kv_mountpoint            = secret {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] vault.kv_path                  = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] vault.kv_version               = 2 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] vault.namespace                = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] vault.root_token_id            = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] vault.ssl_ca_crt_file          = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] vault.timeout                  = 60.0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] vault.token_file               = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] vault.token_role               = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] vault.use_ssl                  = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:38 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] ******************************************************************************** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 28 18:02:38 devstack quobyte-client[86394]: Reading configuration file: /etc/quobyte/client.cfg
Sep 28 18:02:38 devstack quobyte-client[86394]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 28 18:02:38 devstack cinder-volume[86393]: DEBUG oslo_concurrency.processutils [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] CMD "mount.quobyte" returned: 1 in 0.112s {{(pid=86393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:02:38 devstack cinder-volume[86393]: DEBUG oslo_concurrency.lockutils [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:02:38 devstack cinder-volume[86393]: DEBUG oslo_concurrency.lockutils [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:02:38 devstack cinder-volume[86393]: DEBUG cinder.volume.drivers.quobyte [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=86393) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:02:38 devstack cinder-volume[86393]: INFO cinder.volume.drivers.quobyte [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 ...
Sep 28 18:02:38 devstack cinder-volume[86393]: DEBUG oslo_concurrency.processutils [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae -c /etc/quobyte/client-cinder.cfg {{(pid=86393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:02:38 devstack sudo[86395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae -c /etc/quobyte/client-cinder.cfg
Sep 28 18:02:38 devstack sudo[86395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:02:38 devstack sudo[86395]: pam_unix(sudo:session): session closed for user root
Sep 28 18:02:38 devstack cinder-volume[86393]: DEBUG oslo_concurrency.processutils [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.455s {{(pid=86393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:02:38 devstack cinder-volume[86393]: INFO cinder.volume.drivers.quobyte [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 succeeded
Sep 28 18:02:38 devstack cinder-volume[86393]: DEBUG cinder.volume.drivers.quobyte [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=86393) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:02:38 devstack cinder-volume[86393]: DEBUG oslo_concurrency.lockutils [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.471s {{(pid=86393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:02:38 devstack cinder-volume[86393]: DEBUG oslo_concurrency.processutils [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=86393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:02:38 devstack sudo[86505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:02:38 devstack sudo[86505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:02:39 devstack sudo[86505]: pam_unix(sudo:session): session closed for user root
Sep 28 18:02:39 devstack cinder-volume[86393]: DEBUG oslo_concurrency.processutils [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.261s {{(pid=86393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:02:39 devstack cinder-volume[86393]: INFO cinder.volume.driver [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Driver hasn't implemented _init_vendor_properties()
Sep 28 18:02:39 devstack cinder-volume[86393]: DEBUG cinder.volume.driver [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.122184753418, 'free_capacity_gb': 1775.122184753418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86393) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 28 18:02:39 devstack cinder-volume[86393]: DEBUG oslo_db.sqlalchemy.engines [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86393) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 28 18:02:39 devstack cinder-volume[86393]: DEBUG dbcounter [-] [86393] Writer thread running {{(pid=86393) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 28 18:02:39 devstack cinder-volume[86393]: DEBUG cinder.db.api [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Building query based on filter {{(pid=86393) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 28 18:02:39 devstack cinder-volume[86393]: DEBUG cinder.image.image_utils [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86393) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 28 18:02:39 devstack cinder-volume[86393]: INFO cinder.keymgr.migration [None req-5f937002-6853-492d-b6ee-6a4f0aae1578 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 28 18:02:39 devstack cinder-volume[86393]: DEBUG oslo_concurrency.lockutils [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:02:39 devstack cinder-volume[86393]: DEBUG oslo_concurrency.lockutils [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:02:39 devstack cinder-volume[86393]: DEBUG cinder.volume.drivers.quobyte [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=86393) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:02:39 devstack cinder-volume[86393]: DEBUG cinder.volume.drivers.quobyte [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=86393) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:02:39 devstack cinder-volume[86393]: DEBUG oslo_concurrency.lockutils [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:02:39 devstack cinder-volume[86393]: DEBUG oslo_concurrency.processutils [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=86393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:02:39 devstack sudo[86516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:02:39 devstack sudo[86516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:02:39 devstack sudo[86516]: pam_unix(sudo:session): session closed for user root
Sep 28 18:02:39 devstack cinder-volume[86393]: DEBUG oslo_concurrency.processutils [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.262s {{(pid=86393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:02:39 devstack cinder-volume[86393]: DEBUG cinder.manager [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Notifying Schedulers of capabilities ... {{(pid=86393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:02:39 devstack cinder-volume[86393]: INFO cinder.volume.manager [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Driver initialization completed successfully.
Sep 28 18:02:39 devstack cinder-volume[86393]: INFO cinder.manager [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Initiating service 3 cleanup
Sep 28 18:02:39 devstack cinder-volume[86393]: INFO cinder.manager [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Service 3 cleanup completed.
Sep 28 18:02:39 devstack cinder-volume[86393]: DEBUG cinder.service [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Creating RPC server for service cinder-volume {{(pid=86393) start /opt/stack/cinder/cinder/service.py:231}}
Sep 28 18:02:39 devstack cinder-volume[86393]: DEBUG cinder.service [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86393) start /opt/stack/cinder/cinder/service.py:237}}
Sep 28 18:02:39 devstack cinder-volume[86393]: INFO cinder.volume.manager [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 28 18:02:39 devstack cinder-volume[86393]: DEBUG oslo_concurrency.lockutils [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:02:39 devstack cinder-volume[86393]: DEBUG oslo_concurrency.lockutils [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:02:39 devstack cinder-volume[86393]: DEBUG cinder.volume.drivers.quobyte [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=86393) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:02:39 devstack cinder-volume[86393]: DEBUG cinder.volume.drivers.quobyte [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=86393) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:02:39 devstack cinder-volume[86393]: DEBUG oslo_concurrency.lockutils [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:02:39 devstack cinder-volume[86393]: DEBUG oslo_concurrency.processutils [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=86393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:02:39 devstack sudo[86527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:02:39 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:02:40 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root
Sep 28 18:02:40 devstack cinder-volume[86393]: DEBUG oslo_concurrency.processutils [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.329s {{(pid=86393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:02:40 devstack cinder-volume[86393]: INFO cinder.volume.manager [None req-6be3aa9e-8f8d-448c-9697-2b9d7e73373d None None] Driver post RPC initialization completed successfully.
Sep 28 18:02:44 devstack cinder-volume[86393]: DEBUG oslo_concurrency.lockutils [None req-879bcf2b-dc7b-4763-ab41-a01814a178d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:02:44 devstack cinder-volume[86393]: DEBUG oslo_concurrency.lockutils [None req-879bcf2b-dc7b-4763-ab41-a01814a178d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:02:44 devstack cinder-volume[86393]: DEBUG cinder.volume.drivers.quobyte [None req-879bcf2b-dc7b-4763-ab41-a01814a178d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=86393) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:02:44 devstack cinder-volume[86393]: DEBUG cinder.volume.drivers.quobyte [None req-879bcf2b-dc7b-4763-ab41-a01814a178d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=86393) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:02:44 devstack cinder-volume[86393]: DEBUG oslo_concurrency.lockutils [None req-879bcf2b-dc7b-4763-ab41-a01814a178d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:02:44 devstack cinder-volume[86393]: DEBUG oslo_concurrency.processutils [None req-879bcf2b-dc7b-4763-ab41-a01814a178d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=86393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:02:44 devstack sudo[86723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:02:44 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:02:45 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root
Sep 28 18:02:45 devstack cinder-volume[86393]: DEBUG oslo_concurrency.processutils [None req-879bcf2b-dc7b-4763-ab41-a01814a178d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.292s {{(pid=86393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:02:45 devstack cinder-volume[86393]: DEBUG cinder.manager [None req-879bcf2b-dc7b-4763-ab41-a01814a178d4 None None] Notifying Schedulers of capabilities ... {{(pid=86393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:02:47 devstack cinder-volume[86109]: DEBUG dbcounter [-] [86109] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:02:48 devstack cinder-volume[86109]: INFO oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Caught SIGTERM, stopping children
Sep 28 18:02:48 devstack cinder-volume[86109]: DEBUG oslo_concurrency.lockutils [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Acquiring lock "singleton_lock" {{(pid=86109) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 28 18:02:48 devstack cinder-volume[86109]: DEBUG oslo_concurrency.lockutils [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Acquired lock "singleton_lock" {{(pid=86109) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 28 18:02:48 devstack cinder-volume[86109]: DEBUG oslo_concurrency.lockutils [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Releasing lock "singleton_lock" {{(pid=86109) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 28 18:02:48 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Stop services. {{(pid=86109) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 28 18:02:48 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Killing children. {{(pid=86109) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 28 18:02:48 devstack cinder-volume[86109]: INFO oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Waiting on 1 children to exit
Sep 28 18:02:50 devstack cinder-volume[86393]: DEBUG dbcounter [-] [86393] Writing DB stats cinder:SELECT=4 {{(pid=86393) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:02:50 devstack cinder-volume[86393]: DEBUG dbcounter [-] [86393] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86393) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:02:52 devstack cinder-volume[86393]: DEBUG oslo_concurrency.lockutils [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Acquiring lock "singleton_lock" {{(pid=86393) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 28 18:02:52 devstack cinder-volume[86393]: DEBUG oslo_concurrency.lockutils [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Acquired lock "singleton_lock" {{(pid=86393) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 28 18:02:52 devstack cinder-volume[86393]: DEBUG oslo_concurrency.lockutils [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Releasing lock "singleton_lock" {{(pid=86393) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 28 18:02:52 devstack cinder-volume[86393]: WARNING amqp [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 28 18:02:53 devstack cinder-volume[86393]: WARNING amqp [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 28 18:02:53 devstack cinder-volume[86109]: INFO oslo_service.backend._eventlet.service [None req-74d87b71-7d07-4ef5-824a-7c3b753023d3 None None] Child 86393 exited with status 0
Sep 28 18:02:53 devstack cinder-volume[86820]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 28 18:02:53 devstack cinder-volume[86820]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 28 18:02:53 devstack cinder-volume[86820]: we strongly recommend against using it for new projects.
Sep 28 18:02:53 devstack cinder-volume[86820]: If you are already using Eventlet, we recommend migrating to a different
Sep 28 18:02:53 devstack cinder-volume[86820]: framework.  For more detail see
Sep 28 18:02:53 devstack cinder-volume[86820]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 28 18:02:53 devstack cinder-volume[86820]:   import eventlet  # noqa
Sep 28 18:02:56 devstack cinder-volume[86820]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86820) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 28 18:02:56 devstack cinder-volume[86820]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86820) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 28 18:02:56 devstack cinder-volume[86820]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86820) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 28 18:02:57 devstack cinder-volume[86820]: INFO dbcounter [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] Registered counter for database cinder
Sep 28 18:02:57 devstack cinder-volume[86820]: DEBUG oslo_db.sqlalchemy.engines [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86820) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 28 18:02:57 devstack cinder-volume[86820]: DEBUG dbcounter [-] [86820] Writer thread running {{(pid=86820) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 28 18:02:57 devstack cinder-volume[86820]: INFO cinder.rpc [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 28 18:02:57 devstack cinder-volume[86820]: INFO cinder.rpc [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 28 18:02:57 devstack cinder-volume[86820]: DEBUG oslo_db.sqlalchemy.engines [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86820) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 28 18:02:58 devstack cinder-volume[86820]: INFO cinder.volume.manager [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] Determined volume DB was empty at startup.
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG cinder.volume.manager [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86820) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 28 18:02:58 devstack cinder-volume[86820]: WARNING stevedore.named [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 28 18:02:58 devstack cinder-volume[86820]: WARNING castellan.key_manager [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 28 18:02:58 devstack cinder-volume[86820]: WARNING cinder.keymgr.conf_key_mgr [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 28 18:02:58 devstack cinder-volume[86820]: INFO cinder.volume.manager [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_db.sqlalchemy.engines [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86820) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 28 18:02:58 devstack cinder-volume[86820]: INFO oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] Starting 1 workers
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] Started child 87046 {{(pid=86820) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] Full set of CONF: {{(pid=86820) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] ******************************************************************************** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] Configuration options gathered from: {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] ================================================================================ {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] allow_availability_zone_fallback = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] allow_compression_on_image_upload = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] allowed_direct_url_schemes     = [] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] api_rate_limit                 = True {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[87046]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0)
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] auth_strategy                  = keystone {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_availability_zone      = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_host                   = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_name                   = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_stats_polling_interval = 60 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backup_api_class               = cinder.backup.api.API {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backup_name_template           = backup-%s {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backup_use_same_host           = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backup_use_temp_snapshot       = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] chap_password                  = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] chap_username                  =  {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cinder_internal_tenant_project_id = 9392edb1ad474837a53f0a34904a5ff6 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cinder_internal_tenant_user_id = 2d2964ea9c444d2682d7f07dc295bac7 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cluster                        = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] compression_format             = gzip {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] config_dir                     = [] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] config_source                  = [] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] control_exchange               = openstack {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] debug                          = True {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] default_availability_zone      = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] default_group_type             = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] default_volume_type            = QuobyteHD {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] disk_geometry                  = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] driver_client_cert             = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] driver_client_cert_key         = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] driver_data_namespace          = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] driver_ssl_cert_path           = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] driver_ssl_cert_verify         = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] driver_use_ssl                 = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] enable_new_services            = True {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] enable_unsupported_driver      = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] enforce_multipath_for_image_xfer = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] filter_function                = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] glance_api_insecure            = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] glance_api_servers             = ['http://192.168.122.2/image'] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] glance_api_ssl_compression     = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] glance_ca_certificates_file    = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] glance_certfile                = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] glance_keyfile                 = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] glance_num_retries             = 3 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] glance_request_timeout         = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] goodness_function              = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] graceful_shutdown_timeout      = 5 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] group_api_class                = cinder.group.api.API {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] host                           = devstack {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] image_compress_on_upload       = True {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] image_conversion_address_space_limit = 1 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] image_conversion_cpu_limit     = 60 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] image_conversion_disable       = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] image_introspection_address_space_limit = 1 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] image_introspection_cpu_limit  = 60 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] image_upload_use_cinder_backend = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] image_upload_use_internal_tenant = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] image_volume_cache_enabled     = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] image_volume_cache_max_count   = 0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] image_volume_cache_max_size_gb = 0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] init_host_max_objects_retrieval = 0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] iscsi_target_flags             =  {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] iscsi_write_cache              = on {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] iser_helper                    = tgtadm {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] iser_ip_address                = 192.168.122.2 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] iser_port                      = 3260 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] log_color                      = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] log_config_append              = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] log_dir                        = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] log_file                       = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87046) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] log_options                    = True {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] log_rotate_interval            = 1 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] log_rotate_interval_type       = days {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] log_rotation_type              = none {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] max_age                        = 0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] max_logfile_count              = 30 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] max_logfile_size_mb            = 200 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] max_over_subscription_ratio    = 20.0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] message_reap_interval          = 86400 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] message_ttl                    = 2592000 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] migration_create_volume_timeout_secs = 300 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] monkey_patch                   = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] monkey_patch_modules           = [] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] my_ip                          = 192.168.122.2 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] no_snapshot_gb_quota           = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] num_iser_scan_tries            = 3 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] num_shell_tries                = 3 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] num_volume_device_scan_tries   = 3 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] nvmeof_conn_info_version       = 1 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] nvmet_ns_id                    = 10 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] nvmet_port_id                  = 1 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] osapi_max_limit                = 1000 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] osapi_volume_ext_list          = [] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] osapi_volume_listen_port       = 8776 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] osapi_volume_use_ssl           = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] osapi_volume_workers           = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] per_volume_size_limit          = -1 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] periodic_fuzzy_delay           = 60 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] periodic_interval              = 60 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] public_endpoint                = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] publish_errors                 = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] quota_backup_gigabytes         = 1000 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] quota_backups                  = 10 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] quota_gigabytes                = 1000 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] quota_groups                   = 10 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] quota_snapshots                = 10 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] quota_volumes                  = 10 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] rate_limit_burst               = 0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] rate_limit_except_level        = CRITICAL {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] rate_limit_interval            = 0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] reinit_driver_count            = 3 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] replication_device             = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] report_discard_supported       = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] report_interval                = 120 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] reservation_clean_interval     = 86400 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] reservation_expire             = 86400 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] reserved_image_namespaces      = [] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] reserved_percentage            = 0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] rpc_response_timeout           = 120 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] run_external_periodic_tasks    = True {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] scst_target_driver             = iscsi {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] scst_target_iqn_name           = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] service_down_time              = 720 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] shell_completion               = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] snapshot_name_template         = snapshot-%s {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] split_loggers                  = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] state_path                     = /opt/stack/data/cinder {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] storage_availability_zone      = nova {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] storage_protocol               = iSCSI {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] syslog_log_facility            = LOG_USER {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] target_helper                  = lioadm {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] target_ip_address              = 192.168.122.2 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] target_port                    = 3260 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] target_protocol                = iscsi {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] target_secondary_ip_addresses  = [] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] trace_flags                    = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] transport_url                  = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] until_refresh                  = 0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] use_chap_auth                  = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] use_default_quota_class        = True {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] use_journal                    = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] use_json                       = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] use_multipath_for_image_xfer   = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] use_stderr                     = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] use_syslog                     = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] verify_glance_signatures       = enabled {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] volume_api_class               = cinder.volume.api.API {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] volume_backend_name            = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] volume_clear                   = zero {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] volume_clear_ionice            = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] volume_clear_size              = 0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] volume_copy_bps_limit          = 0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] volume_dd_blocksize            = 1M {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] volume_name_template           = volume-%s {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] volume_service_inithost_offload = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] volume_usage_audit_period      = month {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] zoning_mode                    = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_concurrency.disable_process_locking = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.auth_section = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.auth_type   = password {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.auth_version = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.cache       = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.certfile    = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87046) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.quobyte [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.include_service_catalog = True {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.quobyte [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.insecure    = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.interface   = public {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.keyfile     = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.memcache_password = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Running cmd (subprocess): mount.quobyte {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.memcache_username = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.region_name = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.service_type = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.2/identity {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.backend                  = dogpile.cache.null {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.backend_argument         = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.backend_expiration_time  = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.config_prefix            = cache.oslo {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.debug_cache_backend      = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.enable_retry_client      = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.enable_socket_keepalive  = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.enabled                  = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.expiration_time          = 600 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.hashclient_retry_attempts = 2 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.memcache_dead_retry      = 300 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.memcache_sasl_enabled    = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.password                 = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.proxies                  = [] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.redis_db                 = 0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.redis_server             = localhost:6379 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.retry_attempts           = 2 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.retry_delay              = 0.0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.socket_keepalive_count   = 1 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.socket_keepalive_idle    = 1 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.socket_keepalive_interval = 1 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.socket_timeout           = 1.0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.tls_allowed_ciphers      = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.tls_cafile               = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.tls_certfile             = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.tls_enabled              = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.tls_keyfile              = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cache.username                 = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] coordination.backend_url       = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.asyncio_connection    = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.asyncio_slave_connection = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.backend               = sqlalchemy {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.connection            = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.connection_debug      = 0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.connection_parameters =  {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.connection_recycle_time = 3600 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.connection_trace      = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.db_inc_retry_interval = True {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.db_max_retries        = 20 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.db_max_retry_interval = 10 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.db_retry_interval     = 1 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.max_overflow          = 50 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.max_pool_size         = 5 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.max_retries           = 10 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.mysql_wsrep_sync_wait = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.pool_timeout          = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.retry_interval        = 10 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.slave_connection      = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.sqlite_synchronous    = True {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.synchronous_reader    = True {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] database.use_db_reconnect      = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_tracing.insecure = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] profiler.connection_string     = messaging:// {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] profiler.enabled               = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] profiler.es_doc_type           = notification {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] profiler.es_scroll_size        = 10000 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] profiler.es_scroll_time        = 2m {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] profiler.filter_error_trace    = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] profiler.hmac_keys             = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] profiler.sentinel_service_name = mymaster {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] profiler.socket_timeout        = 0.1 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] profiler.trace_requests        = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] profiler.trace_sqlalchemy      = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] profiler_jaeger.process_tags   = {} {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] profiler_jaeger.service_name_prefix = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] profiler_otlp.service_name_prefix = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_policy.enforce_new_defaults = True {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_policy.policy_default_rule = default {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] privsep_osbrick.group          = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] privsep_osbrick.helper_command = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] privsep_osbrick.user           = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cinder_sys_admin.group         = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cinder_sys_admin.helper_command = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] cinder_sys_admin.user          = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] service_user.auth_section      = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] service_user.auth_type         = password {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] service_user.cafile            = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] service_user.certfile          = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] service_user.collect_timing    = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] service_user.insecure          = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] service_user.keyfile           = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] service_user.send_service_user_token = True {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] service_user.split_loggers     = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] service_user.timeout           = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] service_user.tls_ciphers       = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] service_user.tls_min_version   = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] glance.auth_section            = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack quobyte-client[87050]: Reading configuration file: /etc/quobyte/client.cfg
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] glance.auth_type               = password {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] glance.certfile                = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] glance.collect_timing          = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack quobyte-client[87050]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] glance.insecure                = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] glance.keyfile                 = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] glance.region_name             = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] glance.split_loggers           = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] glance.timeout                 = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] CMD "mount.quobyte" returned: 1 in 0.050s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] glance.tls_ciphers             = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] glance.tls_min_version         = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.backend_availability_zone = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.chap_password = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.chap_username =  {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.disk_geometry = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.driver_client_cert = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.driver_client_cert_key = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.driver_data_namespace = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.driver_use_ssl = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.extra_capabilities = {} {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.filter_function = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.goodness_function = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.iscsi_target_flags =  {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.iscsi_write_cache = on {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.iser_ip_address = 192.168.122.2 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.iser_port     = 3260 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.nas_host      =  {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.nas_login     = admin {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.nas_mount_options = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.nas_password  = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.nas_private_key =  {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.nas_share_path =  {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.num_shell_tries = 3 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.quobyte_volume_url = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.replication_device = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.report_discard_supported = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.reserved_percentage = 0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.target_helper = tgtadm {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.target_ip_address = 192.168.122.2 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.target_port   = 3260 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.target_protocol = iscsi {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.trace_flags   = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.unique_fqdn_network = True {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.use_chap_auth = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.volume_backend_name = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.volume_clear  = zero {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.volume_clear_ionice = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.volume_clear_size = 0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_reports.file_event_handler = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_reports.log_dir           = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.backend_availability_zone = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.backend_host         = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.chap_password        = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.chap_username        = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.disk_geometry        = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack sudo[87053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.driver_client_cert   = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.driver_data_namespace = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack sudo[87053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.extra_capabilities   = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.filter_function      = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.goodness_function    = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.iser_helper          = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.iser_ip_address      = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.iser_port            = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.nas_host             = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.nas_login            = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.nas_mount_options    = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.nas_password         = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.nas_private_key      = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.nas_share_path       = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.num_shell_tries      = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.replication_device   = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.report_discard_supported = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.reserved_percentage  = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.scst_target_driver   = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.storage_protocol     = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.target_helper        = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.target_ip_address    = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.target_port          = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.target_prefix        = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.target_protocol      = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.trace_flags          = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.use_chap_auth        = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.volume_clear         = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.volume_clear_size    = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] QuobyteHD.volumes_dir          = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_notifications.driver = [] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_notifications.retry = -1 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] key_manager.fixed_key          = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican.barbican_api_version  = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican.barbican_endpoint     = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican.barbican_endpoint_type = public {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican.barbican_region_name  = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican.cafile                = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican.certfile              = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican.collect_timing        = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican.insecure              = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican.keyfile               = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican.number_of_retries     = 60 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican.retry_delay           = 1 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican.send_service_user_token = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican.split_loggers         = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican.timeout               = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican.tls_ciphers           = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican.tls_min_version       = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican.verify_ssl            = True {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican.verify_ssl_path       = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican_service_user.auth_section = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican_service_user.auth_type = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican_service_user.cafile   = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican_service_user.certfile = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican_service_user.collect_timing = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican_service_user.insecure = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican_service_user.keyfile  = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican_service_user.split_loggers = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican_service_user.timeout  = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican_service_user.tls_ciphers = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] barbican_service_user.tls_min_version = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] vault.approle_role_id          = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] vault.approle_secret_id        = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] vault.auth_method              = approle {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] vault.auth_path                = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] vault.kv_mountpoint            = secret {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] vault.kv_path                  = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] vault.kv_version               = 2 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] vault.namespace                = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] vault.root_token_id            = **** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] vault.ssl_ca_crt_file          = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] vault.timeout                  = 60.0 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] vault.token_file               = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] vault.token_role               = None {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] vault.use_ssl                  = False {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 28 18:02:58 devstack cinder-volume[86820]: DEBUG oslo_service.backend._eventlet.service [None req-16a40058-ff08-4e80-bd40-831caa8b2642 None None] ******************************************************************************** {{(pid=86820) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 28 18:02:58 devstack sudo[87053]: pam_unix(sudo:session): session closed for user root
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.236s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:02:58 devstack cinder-volume[87046]: INFO cinder.volume.driver [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Driver hasn't implemented _init_vendor_properties()
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG cinder.volume.driver [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.122184753418, 'free_capacity_gb': 1775.122184753418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87046) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG oslo_db.sqlalchemy.engines [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87046) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writer thread running {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG cinder.db.api [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Building query based on filter {{(pid=87046) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87046) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:02:58 devstack cinder-volume[87046]: INFO cinder.keymgr.migration [None req-f0ea1a24-1e5e-4f86-849e-fe51b2912a14 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 28 18:02:58 devstack sudo[87097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:02:58 devstack sudo[87097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:02:58 devstack sudo[87097]: pam_unix(sudo:session): session closed for user root
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.233s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:02:58 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Driver initialization completed successfully.
Sep 28 18:02:58 devstack cinder-volume[87046]: INFO cinder.manager [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Initiating service 3 cleanup
Sep 28 18:02:58 devstack cinder-volume[87046]: INFO cinder.manager [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Service 3 cleanup completed.
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG cinder.service [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Creating RPC server for service cinder-volume {{(pid=87046) start /opt/stack/cinder/cinder/service.py:231}}
Sep 28 18:02:58 devstack cinder-volume[87046]: DEBUG cinder.service [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87046) start /opt/stack/cinder/cinder/service.py:237}}
Sep 28 18:02:59 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 28 18:02:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:02:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:02:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:02:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:02:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:02:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:02:59 devstack sudo[87110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:02:59 devstack sudo[87110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:02:59 devstack sudo[87110]: pam_unix(sudo:session): session closed for user root
Sep 28 18:02:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.244s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:02:59 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d696c51b-3a71-4a17-9847-301a2ff69b46 None None] Driver post RPC initialization completed successfully.
Sep 28 18:03:08 devstack cinder-volume[86820]: DEBUG dbcounter [-] [86820] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86820) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:03:08 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=2 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:03:09 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:03:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:03:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 6 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:03:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Flow 'volume_create_manager' (561d7383-ffd6-4f1e-bcb7-65edce7d051a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f57e9e4-827f-4dfd-b4cb-cc8959bc3b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f57e9e4-827f-4dfd-b4cb-cc8959bc3b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1671144577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa29b11d-8518-45e1-b688-405695dff886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b696660cfe614248945ff9215579dab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:57Z,use_quota=True,user_id='7fccc14208e84dc9b530a3af9b829b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f62011b-fe9c-4456-ae82-c4f0758fced7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f62011b-fe9c-4456-ae82-c4f0758fced7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd25081b-05f8-474b-a2fd-e14ebc4f1ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd25081b-05f8-474b-a2fd-e14ebc4f1ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa29b11d-8518-45e1-b688-405695dff886', 'volume_name': 'volume-fa29b11d-8518-45e1-b688-405695dff886', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b68317-f393-4a59-a97c-dc2049001789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b68317-f393-4a59-a97c-dc2049001789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425586d8-ccaa-4293-8d22-5c855681c4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:03:57 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Volume fa29b11d-8518-45e1-b688-405695dff886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa29b11d-8518-45e1-b688-405695dff886', 'volume_size': 1}
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1671144577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa29b11d-8518-45e1-b688-405695dff886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b696660cfe614248945ff9215579dab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:57Z,use_quota=True,user_id='7fccc14208e84dc9b530a3af9b829b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Creating volume fa29b11d-8518-45e1-b688-405695dff886 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:03:57 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fa29b11d-8518-45e1-b688-405695dff886 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:03:57 devstack sudo[87255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fa29b11d-8518-45e1-b688-405695dff886 1073741824
Sep 28 18:03:57 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:03:57 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root
Sep 28 18:03:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fa29b11d-8518-45e1-b688-405695dff886 1073741824" returned: 0 in 0.744s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:03:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fa29b11d-8518-45e1-b688-405695dff886 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:03:58 devstack sudo[87577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fa29b11d-8518-45e1-b688-405695dff886
Sep 28 18:03:58 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:03:58 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root
Sep 28 18:03:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fa29b11d-8518-45e1-b688-405695dff886" returned: 0 in 0.439s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:03:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:03:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:03:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425586d8-ccaa-4293-8d22-5c855681c4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa29b11d-8518-45e1-b688-405695dff886', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:03:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee3343b-e5cd-4344-ab59-746bf9bb6eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:03:58 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Volume volume-fa29b11d-8518-45e1-b688-405695dff886 (fa29b11d-8518-45e1-b688-405695dff886): created successfully
Sep 28 18:03:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee3343b-e5cd-4344-ab59-746bf9bb6eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:03:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Flow 'volume_create_manager' (561d7383-ffd6-4f1e-bcb7-65edce7d051a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:03:58 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-c4147c94-fcd8-444a-9b23-f3881a417c24 tempest-TaggedAttachmentsTest-1277950928 None] Created volume successfully.
Sep 28 18:04:08 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:UPDATE=5 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:04:08 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:04:27 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:04:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Flow 'volume_create_manager' (218a9a2c-f6a2-4fbd-b268-d83259a3af0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:04:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8bb01d8-bdca-4b43-ad1f-ce50dec9b655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:04:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8bb01d8-bdca-4b43-ad1f-ce50dec9b655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-155670928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8c3412-293c-4a0f-b0a7-5a2c5dca854a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ada7be6c205346d1959d156662ea2f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:27Z,use_quota=True,user_id='664951ea054347e4b4bcbd9f269cea89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:04:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e207d6e-cf68-4b21-966f-1ae6841292e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:04:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e207d6e-cf68-4b21-966f-1ae6841292e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:04:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d684c05-9daa-4f0c-9a0f-a5728a1e69cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:04:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d684c05-9daa-4f0c-9a0f-a5728a1e69cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e8c3412-293c-4a0f-b0a7-5a2c5dca854a', 'volume_name': 'volume-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:04:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c673e7a-1035-4a9b-b674-4f43432666fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:04:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c673e7a-1035-4a9b-b674-4f43432666fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:04:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d7932e-0a32-406d-b622-d26c2bbf4287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:04:27 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Volume 3e8c3412-293c-4a0f-b0a7-5a2c5dca854a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a', 'volume_size': 1}
Sep 28 18:04:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:04:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:04:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-155670928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8c3412-293c-4a0f-b0a7-5a2c5dca854a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ada7be6c205346d1959d156662ea2f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:27Z,use_quota=True,user_id='664951ea054347e4b4bcbd9f269cea89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:04:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Creating volume 3e8c3412-293c-4a0f-b0a7-5a2c5dca854a {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:04:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:04:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:04:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:04:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:04:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:04:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:04:27 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:04:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:04:27 devstack sudo[87919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a 1073741824
Sep 28 18:04:27 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:04:29 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root
Sep 28 18:04:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a 1073741824" returned: 0 in 1.484s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:04:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:04:29 devstack sudo[87979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a
Sep 28 18:04:29 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:04:29 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root
Sep 28 18:04:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a" returned: 0 in 0.819s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:04:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] <== create_volume: return (2440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:04:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.443s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:04:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d7932e-0a32-406d-b622-d26c2bbf4287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:04:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cfe456c-938e-46f3-9f5b-9068c6bc5c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:04:30 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Volume volume-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a (3e8c3412-293c-4a0f-b0a7-5a2c5dca854a): created successfully
Sep 28 18:04:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cfe456c-938e-46f3-9f5b-9068c6bc5c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:04:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Flow 'volume_create_manager' (218a9a2c-f6a2-4fbd-b268-d83259a3af0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:04:30 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-001ac821-f80b-4131-baab-2b1d73d6489e tempest-DeleteServersTestJSON-1765110362 None] Created volume successfully.
Sep 28 18:04:36 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:04:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Flow 'volume_create_manager' (4b098de0-81bc-4e96-9ff3-9278923a4824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:04:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (947c8fb1-9340-44b7-a86b-b585f9cfc5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:04:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (947c8fb1-9340-44b7-a86b-b585f9cfc5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1386131804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed149303-8fb9-4e99-bf60-b2e1a0c518f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d032efe230fc4305938cae87a81dbcbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:36Z,use_quota=True,user_id='3f271027b39c44dabdfaf1ae514cca96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:04:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b6967d-d301-4bdd-8727-ee9c4ec271ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:04:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b6967d-d301-4bdd-8727-ee9c4ec271ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:04:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (213194f7-7c6d-4c33-bf0f-a8b71db120c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:04:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (213194f7-7c6d-4c33-bf0f-a8b71db120c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed149303-8fb9-4e99-bf60-b2e1a0c518f0', 'volume_name': 'volume-ed149303-8fb9-4e99-bf60-b2e1a0c518f0', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:04:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c9e4acd-1860-4093-b60a-c87dbd869d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:04:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c9e4acd-1860-4093-b60a-c87dbd869d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:04:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8374553-2f6b-4938-977a-4c4ec1c1cc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:04:36 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Volume ed149303-8fb9-4e99-bf60-b2e1a0c518f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed149303-8fb9-4e99-bf60-b2e1a0c518f0', 'volume_size': 1}
Sep 28 18:04:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:04:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:04:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1386131804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed149303-8fb9-4e99-bf60-b2e1a0c518f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d032efe230fc4305938cae87a81dbcbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:36Z,use_quota=True,user_id='3f271027b39c44dabdfaf1ae514cca96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:04:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Creating volume ed149303-8fb9-4e99-bf60-b2e1a0c518f0 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:04:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:04:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:04:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:04:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:04:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:04:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:04:36 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:04:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ed149303-8fb9-4e99-bf60-b2e1a0c518f0 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:04:36 devstack sudo[88095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ed149303-8fb9-4e99-bf60-b2e1a0c518f0 1073741824
Sep 28 18:04:36 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:04:37 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root
Sep 28 18:04:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ed149303-8fb9-4e99-bf60-b2e1a0c518f0 1073741824" returned: 0 in 1.290s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:04:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ed149303-8fb9-4e99-bf60-b2e1a0c518f0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:04:37 devstack sudo[88114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ed149303-8fb9-4e99-bf60-b2e1a0c518f0
Sep 28 18:04:37 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:04:37 devstack cinder-volume[87046]: WARNING py.warnings [req-160f75ad-de7d-457c-9432-4cc57ed4a33f req-cd5cd0ce-7108-4cbc-9ec5-85ad8dd37333 tempest-DeleteServersTestJSON-1765110362 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Sep 28 18:04:37 devstack cinder-volume[87046]:   .first()
Sep 28 18:04:37 devstack cinder-volume[87046]: 
Sep 28 18:04:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-160f75ad-de7d-457c-9432-4cc57ed4a33f req-cd5cd0ce-7108-4cbc-9ec5-85ad8dd37333 tempest-DeleteServersTestJSON-1765110362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:04:38 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root
Sep 28 18:04:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ed149303-8fb9-4e99-bf60-b2e1a0c518f0" returned: 0 in 0.413s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:04:38 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:04:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:04:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-160f75ad-de7d-457c-9432-4cc57ed4a33f req-cd5cd0ce-7108-4cbc-9ec5-85ad8dd37333 tempest-DeleteServersTestJSON-1765110362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.219s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:04:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8374553-2f6b-4938-977a-4c4ec1c1cc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed149303-8fb9-4e99-bf60-b2e1a0c518f0', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:04:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e70827-bb43-48f4-8949-800ce0cf0aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:04:38 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Volume volume-ed149303-8fb9-4e99-bf60-b2e1a0c518f0 (ed149303-8fb9-4e99-bf60-b2e1a0c518f0): created successfully
Sep 28 18:04:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e70827-bb43-48f4-8949-800ce0cf0aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:04:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Flow 'volume_create_manager' (4b098de0-81bc-4e96-9ff3-9278923a4824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:04:38 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-5b4a64f1-6716-4ca8-bb0a-91c369ed06f6 tempest-VolumesAdminNegativeTest-882727700 None] Created volume successfully.
Sep 28 18:04:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-160f75ad-de7d-457c-9432-4cc57ed4a33f req-cd5cd0ce-7108-4cbc-9ec5-85ad8dd37333 tempest-DeleteServersTestJSON-1765110362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.288s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:04:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-160f75ad-de7d-457c-9432-4cc57ed4a33f req-cd5cd0ce-7108-4cbc-9ec5-85ad8dd37333 tempest-DeleteServersTestJSON-1765110362 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb38b7e4-cca7-4e4a-b05f-ab5959dd3c76', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:04:38 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-160f75ad-de7d-457c-9432-4cc57ed4a33f req-cd5cd0ce-7108-4cbc-9ec5-85ad8dd37333 tempest-DeleteServersTestJSON-1765110362 None] attachment_update completed successfully.
Sep 28 18:04:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:04:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:04:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:04:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:04:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:04:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:04:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:04:39 devstack sudo[88132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:04:39 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:04:40 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root
Sep 28 18:04:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.955s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:04:40 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:04:40 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:04:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 6 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:04:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:04:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] Acquiring lock "cinder-ed149303-8fb9-4e99-bf60-b2e1a0c518f0-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:04:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] Lock "cinder-ed149303-8fb9-4e99-bf60-b2e1a0c518f0-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:04:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] Acquiring lock "cinder-quobyte-ed149303-8fb9-4e99-bf60-b2e1a0c518f0" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:04:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] Lock "cinder-quobyte-ed149303-8fb9-4e99-bf60-b2e1a0c518f0" acquired by "delete_volume" :: waited 0.041s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:04:40 devstack cinder-volume[87046]: INFO oslo.privsep.daemon [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp5gtuttid/privsep.sock']
Sep 28 18:04:41 devstack sudo[88554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp5gtuttid/privsep.sock
Sep 28 18:04:41 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:04:42 devstack cinder-volume[87046]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 28 18:04:42 devstack cinder-volume[87046]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 28 18:04:42 devstack cinder-volume[87046]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 28 18:04:42 devstack cinder-volume[87046]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 28 18:04:42 devstack cinder-volume[87046]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 28 18:04:42 devstack cinder-volume[87046]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 28 18:04:42 devstack cinder-volume[87046]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 28 18:04:42 devstack cinder-volume[87046]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 28 18:04:42 devstack cinder-volume[87046]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 28 18:04:43 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root
Sep 28 18:04:43 devstack cinder-volume[87046]: INFO oslo.privsep.daemon [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] Spawned new privsep daemon via rootwrap
Sep 28 18:04:43 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] Accepted privsep connection to /tmp/tmp5gtuttid/privsep.sock {{(pid=87046) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 28 18:04:43 devstack cinder-volume[87046]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 28 18:04:43 devstack cinder-volume[87046]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 28 18:04:43 devstack cinder-volume[87046]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 28 18:04:43 devstack cinder-volume[87046]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88559
Sep 28 18:04:43 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1cd19a-af94-46d2-b209-bf6ed07f2882]: (2,) {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:04:43 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7b6e78-fecb-4592-9f5d-f14a94cd9bb4]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:04:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ed149303-8fb9-4e99-bf60-b2e1a0c518f0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:04:43 devstack sudo[88561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ed149303-8fb9-4e99-bf60-b2e1a0c518f0
Sep 28 18:04:43 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:04:44 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root
Sep 28 18:04:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ed149303-8fb9-4e99-bf60-b2e1a0c518f0" returned: 0 in 1.275s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:04:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ed149303-8fb9-4e99-bf60-b2e1a0c518f0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:04:44 devstack sudo[88569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ed149303-8fb9-4e99-bf60-b2e1a0c518f0
Sep 28 18:04:44 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:04:45 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root
Sep 28 18:04:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ed149303-8fb9-4e99-bf60-b2e1a0c518f0" returned: 0 in 0.964s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:04:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] Lock "cinder-quobyte-ed149303-8fb9-4e99-bf60-b2e1a0c518f0" released by "delete_volume" :: held 4.700s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:04:45 devstack cinder-volume[87046]: WARNING cinder.quota [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:04:45 devstack cinder-volume[87046]: WARNING cinder.quota [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:04:45 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] Created reservations ['b9e2401e-7c08-4102-9300-074244c8e377', '13508864-c6b0-45a2-82ca-f0d07e86ee65', '4d5cabc0-f9a2-474a-813e-a8a3a7781bd4', 'e81eee9e-1c34-49ce-b069-53c14734724d'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:04:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:04:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:04:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:04:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:04:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:04:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:04:46 devstack sudo[88625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:04:46 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:04:46 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root
Sep 28 18:04:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.525s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:04:46 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:04:46 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] Deleted volume successfully.
Sep 28 18:04:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c07535cb-6887-4b84-957c-a1b9339f50b8 tempest-VolumesAdminNegativeTest-882727700 None] Lock "cinder-ed149303-8fb9-4e99-bf60-b2e1a0c518f0-delete_volume" released by "delete_volume" :: held 6.105s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:04:48 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-2dd8384b-62fa-41d2-a6ef-fc906bc21275 req-92efe7ab-c6e7-4619-960a-6f5fe29ab4cc tempest-DeleteServersTestJSON-1765110362 None] Terminate volume connection completed successfully.
Sep 28 18:04:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-2dd8384b-62fa-41d2-a6ef-fc906bc21275 req-92efe7ab-c6e7-4619-960a-6f5fe29ab4cc tempest-DeleteServersTestJSON-1765110362 None] Deleting attachment fb38b7e4-cca7-4e4a-b05f-ab5959dd3c76. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:04:50 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-64158c28-e431-4434-95d4-f2bc187f125e tempest-DeleteServersTestJSON-1765110362 None] Acquiring lock "cinder-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:04:50 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-64158c28-e431-4434-95d4-f2bc187f125e tempest-DeleteServersTestJSON-1765110362 None] Lock "cinder-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:04:50 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-64158c28-e431-4434-95d4-f2bc187f125e tempest-DeleteServersTestJSON-1765110362 None] Acquiring lock "cinder-quobyte-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:04:50 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-64158c28-e431-4434-95d4-f2bc187f125e tempest-DeleteServersTestJSON-1765110362 None] Lock "cinder-quobyte-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a" acquired by "delete_volume" :: waited 0.025s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:04:50 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e6aefa-d2f2-4266-8450-c085f6b73415]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:04:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-64158c28-e431-4434-95d4-f2bc187f125e tempest-DeleteServersTestJSON-1765110362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:04:51 devstack sudo[88663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a
Sep 28 18:04:51 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:04:51 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root
Sep 28 18:04:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-64158c28-e431-4434-95d4-f2bc187f125e tempest-DeleteServersTestJSON-1765110362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a" returned: 0 in 0.402s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:04:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-64158c28-e431-4434-95d4-f2bc187f125e tempest-DeleteServersTestJSON-1765110362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:04:51 devstack sudo[88668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a
Sep 28 18:04:51 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:04:51 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root
Sep 28 18:04:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-64158c28-e431-4434-95d4-f2bc187f125e tempest-DeleteServersTestJSON-1765110362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a" returned: 0 in 0.355s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:04:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-64158c28-e431-4434-95d4-f2bc187f125e tempest-DeleteServersTestJSON-1765110362 None] Lock "cinder-quobyte-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a" released by "delete_volume" :: held 0.817s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:04:51 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-64158c28-e431-4434-95d4-f2bc187f125e tempest-DeleteServersTestJSON-1765110362 None] Created reservations ['5ffc344f-e33c-43ee-9ecf-5384de03fd65', '2c2d5474-bf8b-4c41-890d-ee345ecea200', '697e5a5f-6c8e-4c3d-b428-c7d087654ad7', '4d8de8b0-7d75-4b23-945f-780be9b827e8'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:04:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-64158c28-e431-4434-95d4-f2bc187f125e tempest-DeleteServersTestJSON-1765110362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:04:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-64158c28-e431-4434-95d4-f2bc187f125e tempest-DeleteServersTestJSON-1765110362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:04:52 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-64158c28-e431-4434-95d4-f2bc187f125e tempest-DeleteServersTestJSON-1765110362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:04:52 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-64158c28-e431-4434-95d4-f2bc187f125e tempest-DeleteServersTestJSON-1765110362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:04:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-64158c28-e431-4434-95d4-f2bc187f125e tempest-DeleteServersTestJSON-1765110362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:04:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-64158c28-e431-4434-95d4-f2bc187f125e tempest-DeleteServersTestJSON-1765110362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:04:52 devstack sudo[88673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:04:52 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:04:52 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root
Sep 28 18:04:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-64158c28-e431-4434-95d4-f2bc187f125e tempest-DeleteServersTestJSON-1765110362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.480s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:04:52 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-64158c28-e431-4434-95d4-f2bc187f125e tempest-DeleteServersTestJSON-1765110362 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:04:52 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-64158c28-e431-4434-95d4-f2bc187f125e tempest-DeleteServersTestJSON-1765110362 None] Deleted volume successfully.
Sep 28 18:04:52 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-64158c28-e431-4434-95d4-f2bc187f125e tempest-DeleteServersTestJSON-1765110362 None] Lock "cinder-3e8c3412-293c-4a0f-b0a7-5a2c5dca854a-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:05:09 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=24,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:05:09 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=20,cinder:UPDATE=22,cinder:DELETE=2,cinder:INSERT=5 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:05:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-f9bf576d-a2c5-4b8b-883e-51223ed41314 req-ee9cb095-e3fd-43be-946d-4bf4f3bd9681 tempest-TaggedAttachmentsTest-1277950928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:05:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-f9bf576d-a2c5-4b8b-883e-51223ed41314 req-ee9cb095-e3fd-43be-946d-4bf4f3bd9681 tempest-TaggedAttachmentsTest-1277950928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:05:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-f9bf576d-a2c5-4b8b-883e-51223ed41314 req-ee9cb095-e3fd-43be-946d-4bf4f3bd9681 tempest-TaggedAttachmentsTest-1277950928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:05:24 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-f9bf576d-a2c5-4b8b-883e-51223ed41314 req-ee9cb095-e3fd-43be-946d-4bf4f3bd9681 tempest-TaggedAttachmentsTest-1277950928 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-fa29b11d-8518-45e1-b688-405695dff886', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '724db480-d6ab-450e-8f48-bd9f3d1d4f3c', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:05:24 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-f9bf576d-a2c5-4b8b-883e-51223ed41314 req-ee9cb095-e3fd-43be-946d-4bf4f3bd9681 tempest-TaggedAttachmentsTest-1277950928 None] attachment_update completed successfully.
Sep 28 18:05:27 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:05:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Flow 'volume_create_manager' (4c7dd3f6-7fa0-4462-b5fb-ec6be2e9d8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:05:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2f9fca-7cd4-4c6f-99be-b76348c09a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:05:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2f9fca-7cd4-4c6f-99be-b76348c09a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1747868465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16db8f0e-364e-4a94-b154-765f198aad54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cab52a87351d4f489e0193be13bfeae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:27Z,use_quota=True,user_id='e6aee06bda8c458289bb0b09c306eaad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:05:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b305fb-19e1-4621-af6d-62b86e1fc843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:05:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b305fb-19e1-4621-af6d-62b86e1fc843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:05:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a5f186-f021-4e7a-80d4-5a7332e10157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:05:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a5f186-f021-4e7a-80d4-5a7332e10157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16db8f0e-364e-4a94-b154-765f198aad54', 'volume_name': 'volume-16db8f0e-364e-4a94-b154-765f198aad54', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:05:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed5b1769-1b8e-4e24-afde-44239723163f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:05:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed5b1769-1b8e-4e24-afde-44239723163f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:05:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6837da-b245-46b4-bdca-04c7bf1d2e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:05:27 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Volume 16db8f0e-364e-4a94-b154-765f198aad54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16db8f0e-364e-4a94-b154-765f198aad54', 'volume_size': 1}
Sep 28 18:05:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:05:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:05:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1747868465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16db8f0e-364e-4a94-b154-765f198aad54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cab52a87351d4f489e0193be13bfeae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:27Z,use_quota=True,user_id='e6aee06bda8c458289bb0b09c306eaad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:05:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Creating volume 16db8f0e-364e-4a94-b154-765f198aad54 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:05:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:05:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:05:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:05:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:05:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:05:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:05:27 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:05:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:27 devstack sudo[89317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54 1073741824
Sep 28 18:05:27 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:28 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root
Sep 28 18:05:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54 1073741824" returned: 0 in 0.852s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:05:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:28 devstack sudo[89334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54
Sep 28 18:05:28 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:28 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root
Sep 28 18:05:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54" returned: 0 in 0.485s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:05:28 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:05:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:05:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6837da-b245-46b4-bdca-04c7bf1d2e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16db8f0e-364e-4a94-b154-765f198aad54', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:05:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6989051c-3c44-4b0e-9506-6864689998ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:05:28 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Volume volume-16db8f0e-364e-4a94-b154-765f198aad54 (16db8f0e-364e-4a94-b154-765f198aad54): created successfully
Sep 28 18:05:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6989051c-3c44-4b0e-9506-6864689998ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:05:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Flow 'volume_create_manager' (4c7dd3f6-7fa0-4462-b5fb-ec6be2e9d8e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:05:29 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-8d3f6b66-792c-4acf-b4a0-d641dc68af38 req-c18bea0c-0a12-4e2e-a849-642924a3749b tempest-VolumesSnapshotsTestJSON-857644382 None] Created volume successfully.
Sep 28 18:05:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-4f89c991-f5cb-49ce-b0c8-0bcc16755cc8 req-dccb4cb4-3017-4e73-986d-a06778060f56 tempest-VolumesSnapshotsTestJSON-857644382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:05:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-4f89c991-f5cb-49ce-b0c8-0bcc16755cc8 req-dccb4cb4-3017-4e73-986d-a06778060f56 tempest-VolumesSnapshotsTestJSON-857644382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:05:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [req-4f89c991-f5cb-49ce-b0c8-0bcc16755cc8 req-dccb4cb4-3017-4e73-986d-a06778060f56 tempest-VolumesSnapshotsTestJSON-857644382 None] Creating offline snapshot 8e094721-ca32-4950-bf92-9e655085e85d of volume 16db8f0e-364e-4a94-b154-765f198aad54 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:05:30 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[636ac53f-285f-4b66-9327-43b99f71837a]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:05:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-4f89c991-f5cb-49ce-b0c8-0bcc16755cc8 req-dccb4cb4-3017-4e73-986d-a06778060f56 tempest-VolumesSnapshotsTestJSON-857644382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:30 devstack sudo[89357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54
Sep 28 18:05:30 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:31 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root
Sep 28 18:05:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-4f89c991-f5cb-49ce-b0c8-0bcc16755cc8 req-dccb4cb4-3017-4e73-986d-a06778060f56 tempest-VolumesSnapshotsTestJSON-857644382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54" returned: 0 in 0.760s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:05:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-4f89c991-f5cb-49ce-b0c8-0bcc16755cc8 req-dccb4cb4-3017-4e73-986d-a06778060f56 tempest-VolumesSnapshotsTestJSON-857644382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.8e094721-ca32-4950-bf92-9e655085e85d 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:31 devstack sudo[89365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.8e094721-ca32-4950-bf92-9e655085e85d 1G
Sep 28 18:05:31 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:31 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root
Sep 28 18:05:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-4f89c991-f5cb-49ce-b0c8-0bcc16755cc8 req-dccb4cb4-3017-4e73-986d-a06778060f56 tempest-VolumesSnapshotsTestJSON-857644382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.8e094721-ca32-4950-bf92-9e655085e85d 1G" returned: 0 in 0.777s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:05:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-4f89c991-f5cb-49ce-b0c8-0bcc16755cc8 req-dccb4cb4-3017-4e73-986d-a06778060f56 tempest-VolumesSnapshotsTestJSON-857644382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16db8f0e-364e-4a94-b154-765f198aad54 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.8e094721-ca32-4950-bf92-9e655085e85d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:31 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-a948a174-b99f-4af7-9ada-aa925d8cded3 req-1803cb50-9bd5-4e66-8075-1ea69b89f1f7 tempest-TaggedAttachmentsTest-1277950928 None] Terminate volume connection completed successfully.
Sep 28 18:05:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-a948a174-b99f-4af7-9ada-aa925d8cded3 req-1803cb50-9bd5-4e66-8075-1ea69b89f1f7 tempest-TaggedAttachmentsTest-1277950928 None] Deleting attachment 724db480-d6ab-450e-8f48-bd9f3d1d4f3c. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:05:31 devstack sudo[89414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16db8f0e-364e-4a94-b154-765f198aad54 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.8e094721-ca32-4950-bf92-9e655085e85d
Sep 28 18:05:31 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:32 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root
Sep 28 18:05:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-4f89c991-f5cb-49ce-b0c8-0bcc16755cc8 req-dccb4cb4-3017-4e73-986d-a06778060f56 tempest-VolumesSnapshotsTestJSON-857644382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16db8f0e-364e-4a94-b154-765f198aad54 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.8e094721-ca32-4950-bf92-9e655085e85d" returned: 0 in 0.946s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:05:32 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [req-4f89c991-f5cb-49ce-b0c8-0bcc16755cc8 req-dccb4cb4-3017-4e73-986d-a06778060f56 tempest-VolumesSnapshotsTestJSON-857644382 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.8e094721-ca32-4950-bf92-9e655085e85d is being set with open permissions: ugo+rw
Sep 28 18:05:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-4f89c991-f5cb-49ce-b0c8-0bcc16755cc8 req-dccb4cb4-3017-4e73-986d-a06778060f56 tempest-VolumesSnapshotsTestJSON-857644382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.8e094721-ca32-4950-bf92-9e655085e85d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:32 devstack sudo[89459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.8e094721-ca32-4950-bf92-9e655085e85d
Sep 28 18:05:32 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:33 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root
Sep 28 18:05:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-4f89c991-f5cb-49ce-b0c8-0bcc16755cc8 req-dccb4cb4-3017-4e73-986d-a06778060f56 tempest-VolumesSnapshotsTestJSON-857644382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.8e094721-ca32-4950-bf92-9e655085e85d" returned: 0 in 0.653s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:05:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-4f89c991-f5cb-49ce-b0c8-0bcc16755cc8 req-dccb4cb4-3017-4e73-986d-a06778060f56 tempest-VolumesSnapshotsTestJSON-857644382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:33 devstack sudo[89493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.info
Sep 28 18:05:33 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:34 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root
Sep 28 18:05:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-4f89c991-f5cb-49ce-b0c8-0bcc16755cc8 req-dccb4cb4-3017-4e73-986d-a06778060f56 tempest-VolumesSnapshotsTestJSON-857644382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.info" returned: 0 in 0.483s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:05:34 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [req-4f89c991-f5cb-49ce-b0c8-0bcc16755cc8 req-dccb4cb4-3017-4e73-986d-a06778060f56 tempest-VolumesSnapshotsTestJSON-857644382 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.info is being set with open permissions: ugo+rw
Sep 28 18:05:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-4f89c991-f5cb-49ce-b0c8-0bcc16755cc8 req-dccb4cb4-3017-4e73-986d-a06778060f56 tempest-VolumesSnapshotsTestJSON-857644382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:34 devstack sudo[89512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.info
Sep 28 18:05:34 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:34 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root
Sep 28 18:05:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-4f89c991-f5cb-49ce-b0c8-0bcc16755cc8 req-dccb4cb4-3017-4e73-986d-a06778060f56 tempest-VolumesSnapshotsTestJSON-857644382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.info" returned: 0 in 0.513s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:05:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-4f89c991-f5cb-49ce-b0c8-0bcc16755cc8 req-dccb4cb4-3017-4e73-986d-a06778060f56 tempest-VolumesSnapshotsTestJSON-857644382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.342s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:05:34 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-4f89c991-f5cb-49ce-b0c8-0bcc16755cc8 req-dccb4cb4-3017-4e73-986d-a06778060f56 tempest-VolumesSnapshotsTestJSON-857644382 None] Create snapshot completed successfully
Sep 28 18:05:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] Acquiring lock "cinder-8e094721-ca32-4950-bf92-9e655085e85d-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:05:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] Lock "cinder-8e094721-ca32-4950-bf92-9e655085e85d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:05:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] Acquiring lock "cinder-quobyte-16db8f0e-364e-4a94-b154-765f198aad54" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:05:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] Lock "cinder-quobyte-16db8f0e-364e-4a94-b154-765f198aad54" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:05:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] Acquiring lock "cinder-quobyte-8e094721-ca32-4950-bf92-9e655085e85d" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:05:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] Lock "cinder-quobyte-8e094721-ca32-4950-bf92-9e655085e85d" acquired by "_delete_snapshot" :: waited 0.064s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:05:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] Deleting offline snapshot 8e094721-ca32-4950-bf92-9e655085e85d of volume 16db8f0e-364e-4a94-b154-765f198aad54 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:05:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] snapshot_file for this snap is: volume-16db8f0e-364e-4a94-b154-765f198aad54.8e094721-ca32-4950-bf92-9e655085e85d {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:05:35 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[547b722b-a0ff-4f29-b86a-5ad0ffc88e2f]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:05:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.8e094721-ca32-4950-bf92-9e655085e85d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:36 devstack sudo[89593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.8e094721-ca32-4950-bf92-9e655085e85d
Sep 28 18:05:36 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:36 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root
Sep 28 18:05:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.8e094721-ca32-4950-bf92-9e655085e85d" returned: 0 in 1.130s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:05:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16db8f0e-364e-4a94-b154-765f198aad54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:05:37 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b23b76-f534-481c-9e65-24b597d12855]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:05:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:37 devstack sudo[89630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54
Sep 28 18:05:37 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:38 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root
Sep 28 18:05:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54" returned: 0 in 1.582s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:05:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.8e094721-ca32-4950-bf92-9e655085e85d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:38 devstack sudo[89663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.8e094721-ca32-4950-bf92-9e655085e85d
Sep 28 18:05:38 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:05:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:05:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:05:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:05:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:05:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:05:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:39 devstack sudo[89669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:05:39 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:39 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root
Sep 28 18:05:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.8e094721-ca32-4950-bf92-9e655085e85d" returned: 0 in 1.113s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:05:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.8e094721-ca32-4950-bf92-9e655085e85d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:39 devstack sudo[89671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.8e094721-ca32-4950-bf92-9e655085e85d
Sep 28 18:05:39 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:39 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root
Sep 28 18:05:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.650s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:05:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:05:40 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root
Sep 28 18:05:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54.8e094721-ca32-4950-bf92-9e655085e85d" returned: 0 in 0.607s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:05:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] Lock "cinder-quobyte-8e094721-ca32-4950-bf92-9e655085e85d" released by "_delete_snapshot" :: held 4.834s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:05:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] Lock "cinder-quobyte-16db8f0e-364e-4a94-b154-765f198aad54" released by "delete_snapshot" :: held 4.926s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:05:40 devstack cinder-volume[87046]: WARNING cinder.quota [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:05:40 devstack cinder-volume[87046]: DEBUG cinder.quota [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] Created reservations ['ae10a4f2-5e87-41b1-bd2e-857857230aff', '7d1fc330-465d-4be0-8be3-32837f50b1c8', 'd80e64fd-49e7-4c94-888c-c8219b98d31a', 'b28b92c3-01f9-473d-a838-51a84b5920b1'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:05:40 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] Delete snapshot completed successfully.
Sep 28 18:05:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-4fb940ca-afcd-41b3-a501-b429c8afb294 req-9279b560-d70e-4490-a6f8-b110484e7374 tempest-VolumesSnapshotsTestJSON-857644382 None] Lock "cinder-8e094721-ca32-4950-bf92-9e655085e85d-delete_snapshot" released by "delete_snapshot" :: held 5.431s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:05:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-03a93e6a-b592-4499-8318-d30a33a72045 req-c8aa0cbf-94c7-4637-b27d-7834127952c8 tempest-VolumesSnapshotsTestJSON-857644382 None] Acquiring lock "cinder-16db8f0e-364e-4a94-b154-765f198aad54-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:05:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-03a93e6a-b592-4499-8318-d30a33a72045 req-c8aa0cbf-94c7-4637-b27d-7834127952c8 tempest-VolumesSnapshotsTestJSON-857644382 None] Lock "cinder-16db8f0e-364e-4a94-b154-765f198aad54-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:05:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-03a93e6a-b592-4499-8318-d30a33a72045 req-c8aa0cbf-94c7-4637-b27d-7834127952c8 tempest-VolumesSnapshotsTestJSON-857644382 None] Acquiring lock "cinder-quobyte-16db8f0e-364e-4a94-b154-765f198aad54" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:05:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-03a93e6a-b592-4499-8318-d30a33a72045 req-c8aa0cbf-94c7-4637-b27d-7834127952c8 tempest-VolumesSnapshotsTestJSON-857644382 None] Lock "cinder-quobyte-16db8f0e-364e-4a94-b154-765f198aad54" acquired by "delete_volume" :: waited 0.029s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:05:41 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4907273d-3e2d-439a-a757-32b05ddef83b]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:05:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-03a93e6a-b592-4499-8318-d30a33a72045 req-c8aa0cbf-94c7-4637-b27d-7834127952c8 tempest-VolumesSnapshotsTestJSON-857644382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:42 devstack sudo[89679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54
Sep 28 18:05:42 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:42 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root
Sep 28 18:05:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-03a93e6a-b592-4499-8318-d30a33a72045 req-c8aa0cbf-94c7-4637-b27d-7834127952c8 tempest-VolumesSnapshotsTestJSON-857644382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54" returned: 0 in 0.649s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:05:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-03a93e6a-b592-4499-8318-d30a33a72045 req-c8aa0cbf-94c7-4637-b27d-7834127952c8 tempest-VolumesSnapshotsTestJSON-857644382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:42 devstack sudo[89685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54
Sep 28 18:05:42 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:43 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root
Sep 28 18:05:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-03a93e6a-b592-4499-8318-d30a33a72045 req-c8aa0cbf-94c7-4637-b27d-7834127952c8 tempest-VolumesSnapshotsTestJSON-857644382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-16db8f0e-364e-4a94-b154-765f198aad54" returned: 0 in 0.918s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:05:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-03a93e6a-b592-4499-8318-d30a33a72045 req-c8aa0cbf-94c7-4637-b27d-7834127952c8 tempest-VolumesSnapshotsTestJSON-857644382 None] Lock "cinder-quobyte-16db8f0e-364e-4a94-b154-765f198aad54" released by "delete_volume" :: held 1.787s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:05:43 devstack cinder-volume[87046]: DEBUG cinder.quota [req-03a93e6a-b592-4499-8318-d30a33a72045 req-c8aa0cbf-94c7-4637-b27d-7834127952c8 tempest-VolumesSnapshotsTestJSON-857644382 None] Created reservations ['f112a800-a4cb-4233-9b72-c78c3824dc11', '39e65470-afb0-4761-8578-54106a13fe88', '892731e0-32e0-4987-9db3-e43f7dad0d57', 'ee74ddd7-e35b-4197-821e-1bc690a700fd'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:05:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-03a93e6a-b592-4499-8318-d30a33a72045 req-c8aa0cbf-94c7-4637-b27d-7834127952c8 tempest-VolumesSnapshotsTestJSON-857644382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:05:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-03a93e6a-b592-4499-8318-d30a33a72045 req-c8aa0cbf-94c7-4637-b27d-7834127952c8 tempest-VolumesSnapshotsTestJSON-857644382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:05:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [req-03a93e6a-b592-4499-8318-d30a33a72045 req-c8aa0cbf-94c7-4637-b27d-7834127952c8 tempest-VolumesSnapshotsTestJSON-857644382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:05:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [req-03a93e6a-b592-4499-8318-d30a33a72045 req-c8aa0cbf-94c7-4637-b27d-7834127952c8 tempest-VolumesSnapshotsTestJSON-857644382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:05:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-03a93e6a-b592-4499-8318-d30a33a72045 req-c8aa0cbf-94c7-4637-b27d-7834127952c8 tempest-VolumesSnapshotsTestJSON-857644382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:05:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-03a93e6a-b592-4499-8318-d30a33a72045 req-c8aa0cbf-94c7-4637-b27d-7834127952c8 tempest-VolumesSnapshotsTestJSON-857644382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:44 devstack sudo[89713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:05:44 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:44 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root
Sep 28 18:05:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-03a93e6a-b592-4499-8318-d30a33a72045 req-c8aa0cbf-94c7-4637-b27d-7834127952c8 tempest-VolumesSnapshotsTestJSON-857644382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.431s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:05:44 devstack cinder-volume[87046]: DEBUG cinder.manager [req-03a93e6a-b592-4499-8318-d30a33a72045 req-c8aa0cbf-94c7-4637-b27d-7834127952c8 tempest-VolumesSnapshotsTestJSON-857644382 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:05:44 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-03a93e6a-b592-4499-8318-d30a33a72045 req-c8aa0cbf-94c7-4637-b27d-7834127952c8 tempest-VolumesSnapshotsTestJSON-857644382 None] Deleted volume successfully.
Sep 28 18:05:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-03a93e6a-b592-4499-8318-d30a33a72045 req-c8aa0cbf-94c7-4637-b27d-7834127952c8 tempest-VolumesSnapshotsTestJSON-857644382 None] Lock "cinder-16db8f0e-364e-4a94-b154-765f198aad54-delete_volume" released by "delete_volume" :: held 2.987s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:05:53 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:05:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Flow 'volume_create_manager' (eff7928d-cc47-49ce-94b9-289deebff3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:05:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96e7e99-7b5b-4c0c-8289-43e18d0a7a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:05:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96e7e99-7b5b-4c0c-8289-43e18d0a7a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1248384036',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4a96f8-5306-455e-9145-2bd705cce39c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4634589b0d14a33a0a3965e736a58db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:54Z,use_quota=True,user_id='ceccedb829384670bb39708dd2503a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:05:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35712e0-55bb-4d4c-afb8-c7e9afbb0f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:05:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35712e0-55bb-4d4c-afb8-c7e9afbb0f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:05:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9ca8c2-e538-4f2d-b896-38714cd285c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:05:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9ca8c2-e538-4f2d-b896-38714cd285c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc4a96f8-5306-455e-9145-2bd705cce39c', 'volume_name': 'volume-cc4a96f8-5306-455e-9145-2bd705cce39c', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:05:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab905482-9657-4a0b-ab26-a97d386ead8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:05:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab905482-9657-4a0b-ab26-a97d386ead8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:05:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8b6151-c14e-4295-8e4a-d7047e96f0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:05:53 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Volume cc4a96f8-5306-455e-9145-2bd705cce39c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc4a96f8-5306-455e-9145-2bd705cce39c', 'volume_size': 1}
Sep 28 18:05:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:05:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:05:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1248384036',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4a96f8-5306-455e-9145-2bd705cce39c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4634589b0d14a33a0a3965e736a58db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:54Z,use_quota=True,user_id='ceccedb829384670bb39708dd2503a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:05:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Creating volume cc4a96f8-5306-455e-9145-2bd705cce39c {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:05:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:05:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:05:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:05:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:05:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:05:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:05:53 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:05:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc4a96f8-5306-455e-9145-2bd705cce39c 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:54 devstack sudo[89780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc4a96f8-5306-455e-9145-2bd705cce39c 1073741824
Sep 28 18:05:54 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:54 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root
Sep 28 18:05:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc4a96f8-5306-455e-9145-2bd705cce39c 1073741824" returned: 0 in 0.944s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:05:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc4a96f8-5306-455e-9145-2bd705cce39c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:55 devstack sudo[89826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc4a96f8-5306-455e-9145-2bd705cce39c
Sep 28 18:05:55 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:55 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root
Sep 28 18:05:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc4a96f8-5306-455e-9145-2bd705cce39c" returned: 0 in 0.679s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:05:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:05:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:05:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8b6151-c14e-4295-8e4a-d7047e96f0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc4a96f8-5306-455e-9145-2bd705cce39c', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:05:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d39085d3-1186-4a77-a247-66c6ced5588c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:05:55 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Volume volume-cc4a96f8-5306-455e-9145-2bd705cce39c (cc4a96f8-5306-455e-9145-2bd705cce39c): created successfully
Sep 28 18:05:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d39085d3-1186-4a77-a247-66c6ced5588c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:05:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Flow 'volume_create_manager' (eff7928d-cc47-49ce-94b9-289deebff3f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:05:55 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-fb345d84-1c1c-4813-a89c-56ff7b58b1bb req-2ce6d615-04e3-4043-b3f0-e10b74f21bc2 tempest-VolumesGetTestJSON-1239076271 None] Created volume successfully.
Sep 28 18:05:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-1a025dd5-2dd3-4769-9017-5e410a2822da req-10172165-fcb6-48d8-af5e-6eec844bab01 tempest-VolumesGetTestJSON-1239076271 None] Acquiring lock "cinder-cc4a96f8-5306-455e-9145-2bd705cce39c-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:05:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-1a025dd5-2dd3-4769-9017-5e410a2822da req-10172165-fcb6-48d8-af5e-6eec844bab01 tempest-VolumesGetTestJSON-1239076271 None] Lock "cinder-cc4a96f8-5306-455e-9145-2bd705cce39c-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:05:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-1a025dd5-2dd3-4769-9017-5e410a2822da req-10172165-fcb6-48d8-af5e-6eec844bab01 tempest-VolumesGetTestJSON-1239076271 None] Acquiring lock "cinder-quobyte-cc4a96f8-5306-455e-9145-2bd705cce39c" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:05:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-1a025dd5-2dd3-4769-9017-5e410a2822da req-10172165-fcb6-48d8-af5e-6eec844bab01 tempest-VolumesGetTestJSON-1239076271 None] Lock "cinder-quobyte-cc4a96f8-5306-455e-9145-2bd705cce39c" acquired by "delete_volume" :: waited 0.061s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:05:57 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e67569f-dc59-43d6-ad8e-b2b17814485e]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:05:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-1a025dd5-2dd3-4769-9017-5e410a2822da req-10172165-fcb6-48d8-af5e-6eec844bab01 tempest-VolumesGetTestJSON-1239076271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc4a96f8-5306-455e-9145-2bd705cce39c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-fbb5881a-9753-45d0-a738-d4f8b33436f1 tempest-TaggedAttachmentsTest-1277950928 None] Acquiring lock "cinder-fa29b11d-8518-45e1-b688-405695dff886-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:05:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-fbb5881a-9753-45d0-a738-d4f8b33436f1 tempest-TaggedAttachmentsTest-1277950928 None] Lock "cinder-fa29b11d-8518-45e1-b688-405695dff886-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:05:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-fbb5881a-9753-45d0-a738-d4f8b33436f1 tempest-TaggedAttachmentsTest-1277950928 None] Acquiring lock "cinder-quobyte-fa29b11d-8518-45e1-b688-405695dff886" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:05:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-fbb5881a-9753-45d0-a738-d4f8b33436f1 tempest-TaggedAttachmentsTest-1277950928 None] Lock "cinder-quobyte-fa29b11d-8518-45e1-b688-405695dff886" acquired by "delete_volume" :: waited 0.075s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:05:58 devstack sudo[89894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc4a96f8-5306-455e-9145-2bd705cce39c
Sep 28 18:05:58 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:58 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb293e60-46e2-45e7-ad5c-ef7971ea3ca0]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:05:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fbb5881a-9753-45d0-a738-d4f8b33436f1 tempest-TaggedAttachmentsTest-1277950928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fa29b11d-8518-45e1-b688-405695dff886 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:58 devstack sudo[89899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fa29b11d-8518-45e1-b688-405695dff886
Sep 28 18:05:58 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:58 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root
Sep 28 18:05:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-1a025dd5-2dd3-4769-9017-5e410a2822da req-10172165-fcb6-48d8-af5e-6eec844bab01 tempest-VolumesGetTestJSON-1239076271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc4a96f8-5306-455e-9145-2bd705cce39c" returned: 0 in 0.993s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:05:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-1a025dd5-2dd3-4769-9017-5e410a2822da req-10172165-fcb6-48d8-af5e-6eec844bab01 tempest-VolumesGetTestJSON-1239076271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc4a96f8-5306-455e-9145-2bd705cce39c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:59 devstack sudo[89905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc4a96f8-5306-455e-9145-2bd705cce39c
Sep 28 18:05:59 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:59 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fbb5881a-9753-45d0-a738-d4f8b33436f1 tempest-TaggedAttachmentsTest-1277950928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fa29b11d-8518-45e1-b688-405695dff886" returned: 0 in 0.996s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fbb5881a-9753-45d0-a738-d4f8b33436f1 tempest-TaggedAttachmentsTest-1277950928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fa29b11d-8518-45e1-b688-405695dff886 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:59 devstack sudo[89916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fa29b11d-8518-45e1-b688-405695dff886
Sep 28 18:05:59 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:59 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-1a025dd5-2dd3-4769-9017-5e410a2822da req-10172165-fcb6-48d8-af5e-6eec844bab01 tempest-VolumesGetTestJSON-1239076271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc4a96f8-5306-455e-9145-2bd705cce39c" returned: 0 in 0.731s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-1a025dd5-2dd3-4769-9017-5e410a2822da req-10172165-fcb6-48d8-af5e-6eec844bab01 tempest-VolumesGetTestJSON-1239076271 None] Lock "cinder-quobyte-cc4a96f8-5306-455e-9145-2bd705cce39c" released by "delete_volume" :: held 1.999s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Flow 'volume_create_manager' (a8e18fe3-d47e-48f7-bc32-d61967ef77d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7ce45a-e610-4c3b-9b63-c374baa6fe22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7ce45a-e610-4c3b-9b63-c374baa6fe22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1327284308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62275e4-e6bb-4e02-b61e-1471ce563974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38de66ede5844ec688598bde962c6a36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:00Z,use_quota=True,user_id='04b4a5b10dc34d7181b63d2d19caedf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (180c06cf-4a82-4c45-9a20-ea1b0415128c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (180c06cf-4a82-4c45-9a20-ea1b0415128c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19494559-5f45-44b6-9b95-db7472941527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19494559-5f45-44b6-9b95-db7472941527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c62275e4-e6bb-4e02-b61e-1471ce563974', 'volume_name': 'volume-c62275e4-e6bb-4e02-b61e-1471ce563974', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b160eb-14fd-4470-953d-db394d67b4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b160eb-14fd-4470-953d-db394d67b4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f9a9ed-349e-47f8-bdc4-7f956b80e8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:05:59 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Volume c62275e4-e6bb-4e02-b61e-1471ce563974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c62275e4-e6bb-4e02-b61e-1471ce563974', 'volume_size': 1}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1327284308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62275e4-e6bb-4e02-b61e-1471ce563974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38de66ede5844ec688598bde962c6a36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:00Z,use_quota=True,user_id='04b4a5b10dc34d7181b63d2d19caedf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Creating volume c62275e4-e6bb-4e02-b61e-1471ce563974 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:05:59 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c62275e4-e6bb-4e02-b61e-1471ce563974 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:05:59 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fbb5881a-9753-45d0-a738-d4f8b33436f1 tempest-TaggedAttachmentsTest-1277950928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fa29b11d-8518-45e1-b688-405695dff886" returned: 0 in 0.536s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:05:59 devstack sudo[89920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c62275e4-e6bb-4e02-b61e-1471ce563974 1073741824
Sep 28 18:05:59 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:05:59 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-fbb5881a-9753-45d0-a738-d4f8b33436f1 tempest-TaggedAttachmentsTest-1277950928 None] Lock "cinder-quobyte-fa29b11d-8518-45e1-b688-405695dff886" released by "delete_volume" :: held 1.686s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:06:00 devstack cinder-volume[87046]: DEBUG cinder.quota [req-1a025dd5-2dd3-4769-9017-5e410a2822da req-10172165-fcb6-48d8-af5e-6eec844bab01 tempest-VolumesGetTestJSON-1239076271 None] Created reservations ['c4842fd1-4146-4cc1-aeea-70aa238d2e3d', '63038e6f-8d09-45e5-acf5-ffea8867b7fd', '49ca75ad-f4e5-41f5-a7c7-fcbd0db04ca0', '686bf50c-55fc-4d2a-a87e-8d6e09654625'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:06:00 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-fbb5881a-9753-45d0-a738-d4f8b33436f1 tempest-TaggedAttachmentsTest-1277950928 None] Created reservations ['2c8d1428-dc2d-4fab-88f9-8c00af959e2a', '0aec9d1b-78da-48c5-836b-9c0fae4bf643', '96cbb024-01bc-47c7-a30c-9aa9440c5741', '9f7543e0-dc0a-4996-aaa3-44b7d6555d33'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:06:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-fbb5881a-9753-45d0-a738-d4f8b33436f1 tempest-TaggedAttachmentsTest-1277950928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:06:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-fbb5881a-9753-45d0-a738-d4f8b33436f1 tempest-TaggedAttachmentsTest-1277950928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:06:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-fbb5881a-9753-45d0-a738-d4f8b33436f1 tempest-TaggedAttachmentsTest-1277950928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:06:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-fbb5881a-9753-45d0-a738-d4f8b33436f1 tempest-TaggedAttachmentsTest-1277950928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:06:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-fbb5881a-9753-45d0-a738-d4f8b33436f1 tempest-TaggedAttachmentsTest-1277950928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:06:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fbb5881a-9753-45d0-a738-d4f8b33436f1 tempest-TaggedAttachmentsTest-1277950928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:00 devstack sudo[89922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:06:00 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-1a025dd5-2dd3-4769-9017-5e410a2822da req-10172165-fcb6-48d8-af5e-6eec844bab01 tempest-VolumesGetTestJSON-1239076271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:06:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-1a025dd5-2dd3-4769-9017-5e410a2822da req-10172165-fcb6-48d8-af5e-6eec844bab01 tempest-VolumesGetTestJSON-1239076271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:06:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [req-1a025dd5-2dd3-4769-9017-5e410a2822da req-10172165-fcb6-48d8-af5e-6eec844bab01 tempest-VolumesGetTestJSON-1239076271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:06:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [req-1a025dd5-2dd3-4769-9017-5e410a2822da req-10172165-fcb6-48d8-af5e-6eec844bab01 tempest-VolumesGetTestJSON-1239076271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:06:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-1a025dd5-2dd3-4769-9017-5e410a2822da req-10172165-fcb6-48d8-af5e-6eec844bab01 tempest-VolumesGetTestJSON-1239076271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:06:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-1a025dd5-2dd3-4769-9017-5e410a2822da req-10172165-fcb6-48d8-af5e-6eec844bab01 tempest-VolumesGetTestJSON-1239076271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:00 devstack sudo[89925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:06:00 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:00 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fbb5881a-9753-45d0-a738-d4f8b33436f1 tempest-TaggedAttachmentsTest-1277950928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.485s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:00 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-fbb5881a-9753-45d0-a738-d4f8b33436f1 tempest-TaggedAttachmentsTest-1277950928 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:06:00 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-fbb5881a-9753-45d0-a738-d4f8b33436f1 tempest-TaggedAttachmentsTest-1277950928 None] Deleted volume successfully.
Sep 28 18:06:00 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-1a025dd5-2dd3-4769-9017-5e410a2822da req-10172165-fcb6-48d8-af5e-6eec844bab01 tempest-VolumesGetTestJSON-1239076271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.459s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:00 devstack cinder-volume[87046]: DEBUG cinder.manager [req-1a025dd5-2dd3-4769-9017-5e410a2822da req-10172165-fcb6-48d8-af5e-6eec844bab01 tempest-VolumesGetTestJSON-1239076271 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:06:00 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-1a025dd5-2dd3-4769-9017-5e410a2822da req-10172165-fcb6-48d8-af5e-6eec844bab01 tempest-VolumesGetTestJSON-1239076271 None] Deleted volume successfully.
Sep 28 18:06:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-fbb5881a-9753-45d0-a738-d4f8b33436f1 tempest-TaggedAttachmentsTest-1277950928 None] Lock "cinder-fa29b11d-8518-45e1-b688-405695dff886-delete_volume" released by "delete_volume" :: held 2.793s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:06:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-1a025dd5-2dd3-4769-9017-5e410a2822da req-10172165-fcb6-48d8-af5e-6eec844bab01 tempest-VolumesGetTestJSON-1239076271 None] Lock "cinder-cc4a96f8-5306-455e-9145-2bd705cce39c-delete_volume" released by "delete_volume" :: held 3.319s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:06:01 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c62275e4-e6bb-4e02-b61e-1471ce563974 1073741824" returned: 0 in 1.181s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c62275e4-e6bb-4e02-b61e-1471ce563974 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:01 devstack sudo[89932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c62275e4-e6bb-4e02-b61e-1471ce563974
Sep 28 18:06:01 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:01 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c62275e4-e6bb-4e02-b61e-1471ce563974" returned: 0 in 0.650s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:06:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:06:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f9a9ed-349e-47f8-bdc4-7f956b80e8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c62275e4-e6bb-4e02-b61e-1471ce563974', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:06:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3d05aa-9a6d-43e5-b08e-d6ac04c7d80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:06:02 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Volume volume-c62275e4-e6bb-4e02-b61e-1471ce563974 (c62275e4-e6bb-4e02-b61e-1471ce563974): created successfully
Sep 28 18:06:02 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3d05aa-9a6d-43e5-b08e-d6ac04c7d80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:06:02 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Flow 'volume_create_manager' (a8e18fe3-d47e-48f7-bc32-d61967ef77d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:06:02 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-a13dabf9-aafa-48dc-ae3b-fca961036702 tempest-ServerRescueNegativeTestJSON-711237140 None] Created volume successfully.
Sep 28 18:06:11 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=34,cinder:UPDATE=41,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=41,cinder:UPDATE=42,cinder:DELETE=3,cinder:INSERT=7 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Flow 'volume_create_manager' (23d1fc9f-d5c4-424e-acea-e7e4e04839e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad52a07-e0ad-4454-a10f-063c57f0c884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad52a07-e0ad-4454-a10f-063c57f0c884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2111210298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959162d2-e49b-403c-8faf-d3593a6d30c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='499ad635b0914aa09002688ce602a565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:12Z,use_quota=True,user_id='a01f018edfdd427cb242e2552d80e9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f4126b-44f7-4fa6-af8b-b0b83074e15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f4126b-44f7-4fa6-af8b-b0b83074e15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343d3724-dcc2-40d7-a34e-24948d7e9d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343d3724-dcc2-40d7-a34e-24948d7e9d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '959162d2-e49b-403c-8faf-d3593a6d30c5', 'volume_name': 'volume-959162d2-e49b-403c-8faf-d3593a6d30c5', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae5aa7de-06d8-4f0d-aa05-e7767cb43aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae5aa7de-06d8-4f0d-aa05-e7767cb43aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6b5974-93d5-4e29-81f4-a55f73c855db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:06:12 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Volume 959162d2-e49b-403c-8faf-d3593a6d30c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-959162d2-e49b-403c-8faf-d3593a6d30c5', 'volume_size': 1}
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2111210298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959162d2-e49b-403c-8faf-d3593a6d30c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='499ad635b0914aa09002688ce602a565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:12Z,use_quota=True,user_id='a01f018edfdd427cb242e2552d80e9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Creating volume 959162d2-e49b-403c-8faf-d3593a6d30c5 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:06:12 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:06:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:12 devstack sudo[90062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5 1073741824
Sep 28 18:06:12 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:13 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:06:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Flow 'volume_create_manager' (154a2c11-6121-4ee3-af43-e407fbdf5704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:06:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a7a9fc-4148-4153-8d80-9a530abf3d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:06:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a7a9fc-4148-4153-8d80-9a530abf3d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1831494739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35b8afa-22e2-4558-99d6-cc212fa9b2f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc02dbe19adc4c7fa553c9fa2a260d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:13Z,use_quota=True,user_id='ff320b7e01f445cc87f175e8023ef211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:06:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28716b9f-c598-4763-aedb-35e9ddacb2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:06:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28716b9f-c598-4763-aedb-35e9ddacb2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:06:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efacc89c-2642-4fa7-97c7-2bd7fcfca0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:06:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efacc89c-2642-4fa7-97c7-2bd7fcfca0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a35b8afa-22e2-4558-99d6-cc212fa9b2f7', 'volume_name': 'volume-a35b8afa-22e2-4558-99d6-cc212fa9b2f7', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:06:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd81ffd-7e63-4302-9486-25692076beed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:06:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd81ffd-7e63-4302-9486-25692076beed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:06:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67433ef3-e179-49ba-b268-2247abed8181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:06:13 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Volume a35b8afa-22e2-4558-99d6-cc212fa9b2f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a35b8afa-22e2-4558-99d6-cc212fa9b2f7', 'volume_size': 1}
Sep 28 18:06:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:06:13 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5 1073741824" returned: 0 in 1.044s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:13 devstack sudo[90071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5
Sep 28 18:06:13 devstack sudo[90071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:14 devstack sudo[90071]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5" returned: 0 in 0.594s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:06:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:06:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.055s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:06:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1831494739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35b8afa-22e2-4558-99d6-cc212fa9b2f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc02dbe19adc4c7fa553c9fa2a260d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:13Z,use_quota=True,user_id='ff320b7e01f445cc87f175e8023ef211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:06:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Creating volume a35b8afa-22e2-4558-99d6-cc212fa9b2f7 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:06:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:06:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:06:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:06:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:06:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:06:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:06:14 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:06:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a35b8afa-22e2-4558-99d6-cc212fa9b2f7 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6b5974-93d5-4e29-81f4-a55f73c855db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-959162d2-e49b-403c-8faf-d3593a6d30c5', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:06:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549bb7a4-77af-4475-beb3-e76abe8fc8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:06:14 devstack sudo[90075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a35b8afa-22e2-4558-99d6-cc212fa9b2f7 1073741824
Sep 28 18:06:14 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:14 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Volume volume-959162d2-e49b-403c-8faf-d3593a6d30c5 (959162d2-e49b-403c-8faf-d3593a6d30c5): created successfully
Sep 28 18:06:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549bb7a4-77af-4475-beb3-e76abe8fc8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:06:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Flow 'volume_create_manager' (23d1fc9f-d5c4-424e-acea-e7e4e04839e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:06:14 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-65826ffe-01aa-4e3d-8fac-a80626b69fdc tempest-SnapshotsActionsTest-1607129491 None] Created volume successfully.
Sep 28 18:06:15 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a35b8afa-22e2-4558-99d6-cc212fa9b2f7 1073741824" returned: 0 in 0.839s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a35b8afa-22e2-4558-99d6-cc212fa9b2f7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:15 devstack sudo[90082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a35b8afa-22e2-4558-99d6-cc212fa9b2f7
Sep 28 18:06:15 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-832f68c3-9407-45c3-ac3e-9bf71b6a1efc tempest-SnapshotsActionsTest-1607129491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:06:15 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a35b8afa-22e2-4558-99d6-cc212fa9b2f7" returned: 0 in 0.515s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:06:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:06:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-832f68c3-9407-45c3-ac3e-9bf71b6a1efc tempest-SnapshotsActionsTest-1607129491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:06:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-832f68c3-9407-45c3-ac3e-9bf71b6a1efc tempest-SnapshotsActionsTest-1607129491 None] Creating offline snapshot f982fbef-65a7-49d0-acb4-611b12ddb6e0 of volume 959162d2-e49b-403c-8faf-d3593a6d30c5 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:06:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67433ef3-e179-49ba-b268-2247abed8181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a35b8afa-22e2-4558-99d6-cc212fa9b2f7', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:06:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce4f0440-3b0c-4aa1-95da-bf416a41643f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:06:15 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c835aeeb-d32e-420c-bb38-cce8f0c36421]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:06:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-832f68c3-9407-45c3-ac3e-9bf71b6a1efc tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:15 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Volume volume-a35b8afa-22e2-4558-99d6-cc212fa9b2f7 (a35b8afa-22e2-4558-99d6-cc212fa9b2f7): created successfully
Sep 28 18:06:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce4f0440-3b0c-4aa1-95da-bf416a41643f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:06:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Flow 'volume_create_manager' (154a2c11-6121-4ee3-af43-e407fbdf5704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:06:15 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-64b1a1df-c39b-4451-b39a-f975272db0e5 tempest-ServerActionsTestOtherA-595876003 None] Created volume successfully.
Sep 28 18:06:16 devstack sudo[90085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5
Sep 28 18:06:16 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:16 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-832f68c3-9407-45c3-ac3e-9bf71b6a1efc tempest-SnapshotsActionsTest-1607129491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5" returned: 0 in 0.522s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-832f68c3-9407-45c3-ac3e-9bf71b6a1efc tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:16 devstack sudo[90091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 1G
Sep 28 18:06:16 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:17 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-832f68c3-9407-45c3-ac3e-9bf71b6a1efc tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 1G" returned: 0 in 0.674s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-832f68c3-9407-45c3-ac3e-9bf71b6a1efc tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959162d2-e49b-403c-8faf-d3593a6d30c5 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:17 devstack sudo[90097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959162d2-e49b-403c-8faf-d3593a6d30c5 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0
Sep 28 18:06:17 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:17 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-832f68c3-9407-45c3-ac3e-9bf71b6a1efc tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959162d2-e49b-403c-8faf-d3593a6d30c5 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0" returned: 0 in 0.391s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:17 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-832f68c3-9407-45c3-ac3e-9bf71b6a1efc tempest-SnapshotsActionsTest-1607129491 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 is being set with open permissions: ugo+rw
Sep 28 18:06:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-832f68c3-9407-45c3-ac3e-9bf71b6a1efc tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:17 devstack sudo[90104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0
Sep 28 18:06:17 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:17 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-832f68c3-9407-45c3-ac3e-9bf71b6a1efc tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0" returned: 0 in 0.315s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-832f68c3-9407-45c3-ac3e-9bf71b6a1efc tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:17 devstack sudo[90107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.info
Sep 28 18:06:17 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:18 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-832f68c3-9407-45c3-ac3e-9bf71b6a1efc tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.info" returned: 0 in 0.388s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:18 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-832f68c3-9407-45c3-ac3e-9bf71b6a1efc tempest-SnapshotsActionsTest-1607129491 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.info is being set with open permissions: ugo+rw
Sep 28 18:06:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-832f68c3-9407-45c3-ac3e-9bf71b6a1efc tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:18 devstack sudo[90112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.info
Sep 28 18:06:18 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:18 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-832f68c3-9407-45c3-ac3e-9bf71b6a1efc tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.info" returned: 0 in 0.318s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-832f68c3-9407-45c3-ac3e-9bf71b6a1efc tempest-SnapshotsActionsTest-1607129491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.776s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:06:18 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-832f68c3-9407-45c3-ac3e-9bf71b6a1efc tempest-SnapshotsActionsTest-1607129491 None] Create snapshot completed successfully
Sep 28 18:06:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-33ccfc86-1e37-4e2f-ae34-5f844ddcf04d tempest-SnapshotsActionsTest-1607129491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:06:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-33ccfc86-1e37-4e2f-ae34-5f844ddcf04d tempest-SnapshotsActionsTest-1607129491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:06:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-33ccfc86-1e37-4e2f-ae34-5f844ddcf04d tempest-SnapshotsActionsTest-1607129491 None] Creating offline snapshot 2553d5ee-aa48-4d3a-be73-b9078900ace3 of volume 959162d2-e49b-403c-8faf-d3593a6d30c5 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:06:20 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[04653fc5-e1ea-4b64-bd8a-38f6f3b51156]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:06:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-33ccfc86-1e37-4e2f-ae34-5f844ddcf04d tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:20 devstack sudo[90165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0
Sep 28 18:06:20 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:21 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-33ccfc86-1e37-4e2f-ae34-5f844ddcf04d tempest-SnapshotsActionsTest-1607129491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0" returned: 0 in 0.964s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-33ccfc86-1e37-4e2f-ae34-5f844ddcf04d tempest-SnapshotsActionsTest-1607129491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-959162d2-e49b-403c-8faf-d3593a6d30c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:06:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-33ccfc86-1e37-4e2f-ae34-5f844ddcf04d tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.2553d5ee-aa48-4d3a-be73-b9078900ace3 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:21 devstack sudo[90172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.2553d5ee-aa48-4d3a-be73-b9078900ace3 1G
Sep 28 18:06:21 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:22 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-33ccfc86-1e37-4e2f-ae34-5f844ddcf04d tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.2553d5ee-aa48-4d3a-be73-b9078900ace3 1G" returned: 0 in 1.110s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-33ccfc86-1e37-4e2f-ae34-5f844ddcf04d tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.2553d5ee-aa48-4d3a-be73-b9078900ace3 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:22 devstack sudo[90187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.2553d5ee-aa48-4d3a-be73-b9078900ace3
Sep 28 18:06:22 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-27175562-66a6-494b-9df9-5f662462a9cb tempest-ServerRescueNegativeTestJSON-711237140 None] Acquiring lock "cinder-c62275e4-e6bb-4e02-b61e-1471ce563974-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:06:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-27175562-66a6-494b-9df9-5f662462a9cb tempest-ServerRescueNegativeTestJSON-711237140 None] Lock "cinder-c62275e4-e6bb-4e02-b61e-1471ce563974-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:06:22 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-33ccfc86-1e37-4e2f-ae34-5f844ddcf04d tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.2553d5ee-aa48-4d3a-be73-b9078900ace3" returned: 0 in 0.511s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:22 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-33ccfc86-1e37-4e2f-ae34-5f844ddcf04d tempest-SnapshotsActionsTest-1607129491 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.2553d5ee-aa48-4d3a-be73-b9078900ace3 is being set with open permissions: ugo+rw
Sep 28 18:06:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-33ccfc86-1e37-4e2f-ae34-5f844ddcf04d tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.2553d5ee-aa48-4d3a-be73-b9078900ace3 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:22 devstack sudo[90200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.2553d5ee-aa48-4d3a-be73-b9078900ace3
Sep 28 18:06:22 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-27175562-66a6-494b-9df9-5f662462a9cb tempest-ServerRescueNegativeTestJSON-711237140 None] Acquiring lock "cinder-quobyte-c62275e4-e6bb-4e02-b61e-1471ce563974" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:06:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-27175562-66a6-494b-9df9-5f662462a9cb tempest-ServerRescueNegativeTestJSON-711237140 None] Lock "cinder-quobyte-c62275e4-e6bb-4e02-b61e-1471ce563974" acquired by "delete_volume" :: waited 0.052s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:06:23 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[118e2436-8b3b-4a3f-8af3-9dd39ee53cb4]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:06:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-27175562-66a6-494b-9df9-5f662462a9cb tempest-ServerRescueNegativeTestJSON-711237140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c62275e4-e6bb-4e02-b61e-1471ce563974 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:23 devstack sudo[90206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c62275e4-e6bb-4e02-b61e-1471ce563974
Sep 28 18:06:23 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:23 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-33ccfc86-1e37-4e2f-ae34-5f844ddcf04d tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.2553d5ee-aa48-4d3a-be73-b9078900ace3" returned: 0 in 0.832s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-33ccfc86-1e37-4e2f-ae34-5f844ddcf04d tempest-SnapshotsActionsTest-1607129491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.636s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:06:23 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-33ccfc86-1e37-4e2f-ae34-5f844ddcf04d tempest-SnapshotsActionsTest-1607129491 None] Create snapshot completed successfully
Sep 28 18:06:23 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-27175562-66a6-494b-9df9-5f662462a9cb tempest-ServerRescueNegativeTestJSON-711237140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c62275e4-e6bb-4e02-b61e-1471ce563974" returned: 0 in 0.885s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-27175562-66a6-494b-9df9-5f662462a9cb tempest-ServerRescueNegativeTestJSON-711237140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c62275e4-e6bb-4e02-b61e-1471ce563974 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:24 devstack sudo[90212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c62275e4-e6bb-4e02-b61e-1471ce563974
Sep 28 18:06:24 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:24 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-27175562-66a6-494b-9df9-5f662462a9cb tempest-ServerRescueNegativeTestJSON-711237140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c62275e4-e6bb-4e02-b61e-1471ce563974" returned: 0 in 0.512s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-27175562-66a6-494b-9df9-5f662462a9cb tempest-ServerRescueNegativeTestJSON-711237140 None] Lock "cinder-quobyte-c62275e4-e6bb-4e02-b61e-1471ce563974" released by "delete_volume" :: held 1.509s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:06:24 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-27175562-66a6-494b-9df9-5f662462a9cb tempest-ServerRescueNegativeTestJSON-711237140 None] Created reservations ['190d8ffb-8877-4c52-87f9-b9ead769ef14', 'f5ad0bbd-fe02-4299-a70c-73ad1078995d', '286fe412-4a12-4796-9345-0a8765f156d4', 'a4794eea-6d35-42e1-8ea4-05aa4b6c31cf'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:06:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-27175562-66a6-494b-9df9-5f662462a9cb tempest-ServerRescueNegativeTestJSON-711237140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:06:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-27175562-66a6-494b-9df9-5f662462a9cb tempest-ServerRescueNegativeTestJSON-711237140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:06:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-27175562-66a6-494b-9df9-5f662462a9cb tempest-ServerRescueNegativeTestJSON-711237140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:06:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-27175562-66a6-494b-9df9-5f662462a9cb tempest-ServerRescueNegativeTestJSON-711237140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:06:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-27175562-66a6-494b-9df9-5f662462a9cb tempest-ServerRescueNegativeTestJSON-711237140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:06:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-27175562-66a6-494b-9df9-5f662462a9cb tempest-ServerRescueNegativeTestJSON-711237140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] Acquiring lock "cinder-2553d5ee-aa48-4d3a-be73-b9078900ace3-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:06:24 devstack sudo[90215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:06:24 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-2553d5ee-aa48-4d3a-be73-b9078900ace3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:06:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] Acquiring lock "cinder-quobyte-959162d2-e49b-403c-8faf-d3593a6d30c5" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:06:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-quobyte-959162d2-e49b-403c-8faf-d3593a6d30c5" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:06:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] Acquiring lock "cinder-quobyte-2553d5ee-aa48-4d3a-be73-b9078900ace3" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:06:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-quobyte-2553d5ee-aa48-4d3a-be73-b9078900ace3" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:06:25 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] Deleting offline snapshot 2553d5ee-aa48-4d3a-be73-b9078900ace3 of volume 959162d2-e49b-403c-8faf-d3593a6d30c5 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:06:25 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] snapshot_file for this snap is: volume-959162d2-e49b-403c-8faf-d3593a6d30c5.2553d5ee-aa48-4d3a-be73-b9078900ace3 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:06:25 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2333b95a-3ec0-4ec1-bde0-a49960d46a44]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:06:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.2553d5ee-aa48-4d3a-be73-b9078900ace3 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:25 devstack sudo[90217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.2553d5ee-aa48-4d3a-be73-b9078900ace3
Sep 28 18:06:25 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:25 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-27175562-66a6-494b-9df9-5f662462a9cb tempest-ServerRescueNegativeTestJSON-711237140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.682s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:25 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-27175562-66a6-494b-9df9-5f662462a9cb tempest-ServerRescueNegativeTestJSON-711237140 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:06:25 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-27175562-66a6-494b-9df9-5f662462a9cb tempest-ServerRescueNegativeTestJSON-711237140 None] Deleted volume successfully.
Sep 28 18:06:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-27175562-66a6-494b-9df9-5f662462a9cb tempest-ServerRescueNegativeTestJSON-711237140 None] Lock "cinder-c62275e4-e6bb-4e02-b61e-1471ce563974-delete_volume" released by "delete_volume" :: held 2.840s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:06:26 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.2553d5ee-aa48-4d3a-be73-b9078900ace3" returned: 0 in 1.019s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-959162d2-e49b-403c-8faf-d3593a6d30c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:06:26 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f98c86-80ec-45e2-bcd4-fed63d04fc5d]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:06:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:26 devstack sudo[90231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0
Sep 28 18:06:26 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:27 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0" returned: 0 in 0.879s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-959162d2-e49b-403c-8faf-d3593a6d30c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:06:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.2553d5ee-aa48-4d3a-be73-b9078900ace3 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:27 devstack sudo[90264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.2553d5ee-aa48-4d3a-be73-b9078900ace3
Sep 28 18:06:27 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:27 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.2553d5ee-aa48-4d3a-be73-b9078900ace3" returned: 0 in 0.839s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.2553d5ee-aa48-4d3a-be73-b9078900ace3 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:28 devstack sudo[90272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.2553d5ee-aa48-4d3a-be73-b9078900ace3
Sep 28 18:06:28 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:28 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.2553d5ee-aa48-4d3a-be73-b9078900ace3" returned: 0 in 0.511s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:28 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-quobyte-2553d5ee-aa48-4d3a-be73-b9078900ace3" released by "_delete_snapshot" :: held 3.508s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:06:28 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-quobyte-959162d2-e49b-403c-8faf-d3593a6d30c5" released by "delete_snapshot" :: held 3.548s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:06:28 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] Created reservations ['1c0f4f3d-dee7-4dea-b8c8-57543c710826', 'b0282db7-9022-41d4-a089-8ed077fa78c8', '19238b17-64d7-4066-9577-97bb1e63d2a9', 'b02aa607-3f61-4d8b-b1d1-373f32c3edea'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:06:28 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] Delete snapshot completed successfully.
Sep 28 18:06:28 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-41102c7b-73b5-441f-9caa-b4936eaf2cc8 tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-2553d5ee-aa48-4d3a-be73-b9078900ace3-delete_snapshot" released by "delete_snapshot" :: held 3.873s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:06:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c45aa350-6a9e-469b-8c15-3067ec872608 tempest-SnapshotsActionsTest-1607129491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:06:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c45aa350-6a9e-469b-8c15-3067ec872608 tempest-SnapshotsActionsTest-1607129491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:06:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-c45aa350-6a9e-469b-8c15-3067ec872608 tempest-SnapshotsActionsTest-1607129491 None] Creating offline snapshot 97ef3e19-0c36-4c35-be93-89334f61ef66 of volume 959162d2-e49b-403c-8faf-d3593a6d30c5 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:06:30 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bc4d14-230f-4aa3-80da-e3843590f4f1]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:06:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c45aa350-6a9e-469b-8c15-3067ec872608 tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:30 devstack sudo[90306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0
Sep 28 18:06:30 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:31 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c45aa350-6a9e-469b-8c15-3067ec872608 tempest-SnapshotsActionsTest-1607129491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0" returned: 0 in 0.654s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:31 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-c45aa350-6a9e-469b-8c15-3067ec872608 tempest-SnapshotsActionsTest-1607129491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-959162d2-e49b-403c-8faf-d3593a6d30c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:06:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c45aa350-6a9e-469b-8c15-3067ec872608 tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.97ef3e19-0c36-4c35-be93-89334f61ef66 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:31 devstack sudo[90329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.97ef3e19-0c36-4c35-be93-89334f61ef66 1G
Sep 28 18:06:31 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:32 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c45aa350-6a9e-469b-8c15-3067ec872608 tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.97ef3e19-0c36-4c35-be93-89334f61ef66 1G" returned: 0 in 0.911s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c45aa350-6a9e-469b-8c15-3067ec872608 tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.97ef3e19-0c36-4c35-be93-89334f61ef66 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:32 devstack sudo[90368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.97ef3e19-0c36-4c35-be93-89334f61ef66
Sep 28 18:06:32 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:32 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c45aa350-6a9e-469b-8c15-3067ec872608 tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.97ef3e19-0c36-4c35-be93-89334f61ef66" returned: 0 in 0.404s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:32 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-c45aa350-6a9e-469b-8c15-3067ec872608 tempest-SnapshotsActionsTest-1607129491 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.97ef3e19-0c36-4c35-be93-89334f61ef66 is being set with open permissions: ugo+rw
Sep 28 18:06:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c45aa350-6a9e-469b-8c15-3067ec872608 tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.97ef3e19-0c36-4c35-be93-89334f61ef66 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:32 devstack sudo[90375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.97ef3e19-0c36-4c35-be93-89334f61ef66
Sep 28 18:06:32 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:32 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c45aa350-6a9e-469b-8c15-3067ec872608 tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.97ef3e19-0c36-4c35-be93-89334f61ef66" returned: 0 in 0.320s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c45aa350-6a9e-469b-8c15-3067ec872608 tempest-SnapshotsActionsTest-1607129491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.576s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:06:33 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-c45aa350-6a9e-469b-8c15-3067ec872608 tempest-SnapshotsActionsTest-1607129491 None] Create snapshot completed successfully
Sep 28 18:06:34 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] Acquiring lock "cinder-97ef3e19-0c36-4c35-be93-89334f61ef66-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:06:34 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-97ef3e19-0c36-4c35-be93-89334f61ef66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:06:34 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] Acquiring lock "cinder-quobyte-959162d2-e49b-403c-8faf-d3593a6d30c5" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:06:34 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-quobyte-959162d2-e49b-403c-8faf-d3593a6d30c5" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:06:34 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] Acquiring lock "cinder-quobyte-97ef3e19-0c36-4c35-be93-89334f61ef66" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:06:34 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-quobyte-97ef3e19-0c36-4c35-be93-89334f61ef66" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:06:34 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] Deleting offline snapshot 97ef3e19-0c36-4c35-be93-89334f61ef66 of volume 959162d2-e49b-403c-8faf-d3593a6d30c5 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:06:34 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] snapshot_file for this snap is: volume-959162d2-e49b-403c-8faf-d3593a6d30c5.97ef3e19-0c36-4c35-be93-89334f61ef66 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:06:34 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a507a6b-dcf3-4c2c-acf3-7b60c651d20b]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:06:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.97ef3e19-0c36-4c35-be93-89334f61ef66 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:34 devstack sudo[90385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.97ef3e19-0c36-4c35-be93-89334f61ef66
Sep 28 18:06:34 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:34 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.97ef3e19-0c36-4c35-be93-89334f61ef66" returned: 0 in 0.613s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:34 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-959162d2-e49b-403c-8faf-d3593a6d30c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:06:34 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ecca00-876f-443b-a553-ace0824b19f2]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:06:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:35 devstack sudo[90392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0
Sep 28 18:06:35 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:35 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0" returned: 0 in 0.798s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-959162d2-e49b-403c-8faf-d3593a6d30c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:06:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.97ef3e19-0c36-4c35-be93-89334f61ef66 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:35 devstack sudo[90398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.97ef3e19-0c36-4c35-be93-89334f61ef66
Sep 28 18:06:35 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:36 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.97ef3e19-0c36-4c35-be93-89334f61ef66" returned: 0 in 0.890s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.97ef3e19-0c36-4c35-be93-89334f61ef66 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:36 devstack sudo[90404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.97ef3e19-0c36-4c35-be93-89334f61ef66
Sep 28 18:06:36 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:36 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.97ef3e19-0c36-4c35-be93-89334f61ef66" returned: 0 in 0.361s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-quobyte-97ef3e19-0c36-4c35-be93-89334f61ef66" released by "_delete_snapshot" :: held 2.870s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:06:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-quobyte-959162d2-e49b-403c-8faf-d3593a6d30c5" released by "delete_snapshot" :: held 2.912s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:06:37 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] Created reservations ['66af85e2-3b59-4d05-8a2c-431d6dd42254', 'b35255ce-420b-4cf1-baa7-21c2813a4960', '5b2360a7-2dbf-4dab-bd69-5f0d6b4bf08a', '61db2587-dea4-4b5b-af60-8af46b0f9f2d'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:06:37 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] Delete snapshot completed successfully.
Sep 28 18:06:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-38b0def7-1bff-4657-b8a0-ce323d4d3d67 tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-97ef3e19-0c36-4c35-be93-89334f61ef66-delete_snapshot" released by "delete_snapshot" :: held 3.138s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:06:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5fe7b998-bb64-460e-a213-ad629ac654f6 tempest-SnapshotsActionsTest-1607129491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:06:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5fe7b998-bb64-460e-a213-ad629ac654f6 tempest-SnapshotsActionsTest-1607129491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:06:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-5fe7b998-bb64-460e-a213-ad629ac654f6 tempest-SnapshotsActionsTest-1607129491 None] Creating offline snapshot 23ead9a1-ddf9-4395-bb1a-74c6469d57b7 of volume 959162d2-e49b-403c-8faf-d3593a6d30c5 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:06:37 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ff2bd6-141c-454c-abaf-20a7720c0ece]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:06:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5fe7b998-bb64-460e-a213-ad629ac654f6 tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:38 devstack sudo[90408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0
Sep 28 18:06:38 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:38 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5fe7b998-bb64-460e-a213-ad629ac654f6 tempest-SnapshotsActionsTest-1607129491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0" returned: 0 in 0.727s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:38 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-5fe7b998-bb64-460e-a213-ad629ac654f6 tempest-SnapshotsActionsTest-1607129491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-959162d2-e49b-403c-8faf-d3593a6d30c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:06:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5fe7b998-bb64-460e-a213-ad629ac654f6 tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.23ead9a1-ddf9-4395-bb1a-74c6469d57b7 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:38 devstack sudo[90413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.23ead9a1-ddf9-4395-bb1a-74c6469d57b7 1G
Sep 28 18:06:38 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:06:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:06:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:06:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:06:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:06:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:06:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:39 devstack sudo[90419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:06:39 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:39 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5fe7b998-bb64-460e-a213-ad629ac654f6 tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.23ead9a1-ddf9-4395-bb1a-74c6469d57b7 1G" returned: 0 in 0.726s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5fe7b998-bb64-460e-a213-ad629ac654f6 tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.23ead9a1-ddf9-4395-bb1a-74c6469d57b7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:39 devstack sudo[90421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.23ead9a1-ddf9-4395-bb1a-74c6469d57b7
Sep 28 18:06:39 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:39 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.523s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:06:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:06:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 8 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:06:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:06:40 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5fe7b998-bb64-460e-a213-ad629ac654f6 tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.23ead9a1-ddf9-4395-bb1a-74c6469d57b7" returned: 0 in 0.608s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:40 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-5fe7b998-bb64-460e-a213-ad629ac654f6 tempest-SnapshotsActionsTest-1607129491 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.23ead9a1-ddf9-4395-bb1a-74c6469d57b7 is being set with open permissions: ugo+rw
Sep 28 18:06:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5fe7b998-bb64-460e-a213-ad629ac654f6 tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.23ead9a1-ddf9-4395-bb1a-74c6469d57b7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:40 devstack sudo[90427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.23ead9a1-ddf9-4395-bb1a-74c6469d57b7
Sep 28 18:06:40 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:40 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5fe7b998-bb64-460e-a213-ad629ac654f6 tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.23ead9a1-ddf9-4395-bb1a-74c6469d57b7" returned: 0 in 0.401s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5fe7b998-bb64-460e-a213-ad629ac654f6 tempest-SnapshotsActionsTest-1607129491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.665s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:06:40 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-5fe7b998-bb64-460e-a213-ad629ac654f6 tempest-SnapshotsActionsTest-1607129491 None] Create snapshot completed successfully
Sep 28 18:06:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] Acquiring lock "cinder-23ead9a1-ddf9-4395-bb1a-74c6469d57b7-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:06:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-23ead9a1-ddf9-4395-bb1a-74c6469d57b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:06:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] Acquiring lock "cinder-quobyte-959162d2-e49b-403c-8faf-d3593a6d30c5" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:06:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-quobyte-959162d2-e49b-403c-8faf-d3593a6d30c5" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:06:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] Acquiring lock "cinder-quobyte-23ead9a1-ddf9-4395-bb1a-74c6469d57b7" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:06:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-quobyte-23ead9a1-ddf9-4395-bb1a-74c6469d57b7" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:06:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] Deleting offline snapshot 23ead9a1-ddf9-4395-bb1a-74c6469d57b7 of volume 959162d2-e49b-403c-8faf-d3593a6d30c5 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:06:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] snapshot_file for this snap is: volume-959162d2-e49b-403c-8faf-d3593a6d30c5.23ead9a1-ddf9-4395-bb1a-74c6469d57b7 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:06:41 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[420d96f6-58c9-48d4-8884-9e3390446c93]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:06:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.23ead9a1-ddf9-4395-bb1a-74c6469d57b7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:41 devstack sudo[90432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.23ead9a1-ddf9-4395-bb1a-74c6469d57b7
Sep 28 18:06:41 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:41 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.23ead9a1-ddf9-4395-bb1a-74c6469d57b7" returned: 0 in 0.530s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-959162d2-e49b-403c-8faf-d3593a6d30c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:06:42 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8666531-cf8e-4fe4-b842-99dd7e1676c1]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:06:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:42 devstack sudo[90439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0
Sep 28 18:06:42 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:42 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0" returned: 0 in 0.586s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-959162d2-e49b-403c-8faf-d3593a6d30c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:06:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.23ead9a1-ddf9-4395-bb1a-74c6469d57b7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:42 devstack sudo[90445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.23ead9a1-ddf9-4395-bb1a-74c6469d57b7
Sep 28 18:06:42 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:43 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.23ead9a1-ddf9-4395-bb1a-74c6469d57b7" returned: 0 in 0.572s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.23ead9a1-ddf9-4395-bb1a-74c6469d57b7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:43 devstack sudo[90451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.23ead9a1-ddf9-4395-bb1a-74c6469d57b7
Sep 28 18:06:43 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:43 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.23ead9a1-ddf9-4395-bb1a-74c6469d57b7" returned: 0 in 0.458s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-quobyte-23ead9a1-ddf9-4395-bb1a-74c6469d57b7" released by "_delete_snapshot" :: held 2.344s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:06:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-quobyte-959162d2-e49b-403c-8faf-d3593a6d30c5" released by "delete_snapshot" :: held 2.396s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:06:43 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] Created reservations ['12586f38-9d7d-4989-a318-4f315328c0e6', '4e522798-eac6-4762-95f3-db70528aea3e', '97c95263-42ea-40f1-97a2-b48a47e5ecc9', 'e71eb1e8-6537-4e10-8125-0f294d6a138e'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:06:43 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] Delete snapshot completed successfully.
Sep 28 18:06:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5aeb7df3-1fa3-4b62-87e1-44afe1d13af5 tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-23ead9a1-ddf9-4395-bb1a-74c6469d57b7-delete_snapshot" released by "delete_snapshot" :: held 2.691s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:06:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-00d45474-b20c-4814-b387-115d9a51bc1b tempest-SnapshotsActionsTest-1607129491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:06:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-00d45474-b20c-4814-b387-115d9a51bc1b tempest-SnapshotsActionsTest-1607129491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:06:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-00d45474-b20c-4814-b387-115d9a51bc1b tempest-SnapshotsActionsTest-1607129491 None] Creating offline snapshot b9948125-2a68-484b-9b81-6002acc53983 of volume 959162d2-e49b-403c-8faf-d3593a6d30c5 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:06:45 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1a16dc-7853-478d-8f30-de57ffec57c0]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:06:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-00d45474-b20c-4814-b387-115d9a51bc1b tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:45 devstack sudo[90454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0
Sep 28 18:06:45 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:45 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-00d45474-b20c-4814-b387-115d9a51bc1b tempest-SnapshotsActionsTest-1607129491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0" returned: 0 in 0.683s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-00d45474-b20c-4814-b387-115d9a51bc1b tempest-SnapshotsActionsTest-1607129491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-959162d2-e49b-403c-8faf-d3593a6d30c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:06:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-00d45474-b20c-4814-b387-115d9a51bc1b tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.b9948125-2a68-484b-9b81-6002acc53983 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:46 devstack sudo[90459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.b9948125-2a68-484b-9b81-6002acc53983 1G
Sep 28 18:06:46 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:47 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-00d45474-b20c-4814-b387-115d9a51bc1b tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.b9948125-2a68-484b-9b81-6002acc53983 1G" returned: 0 in 1.370s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-00d45474-b20c-4814-b387-115d9a51bc1b tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.b9948125-2a68-484b-9b81-6002acc53983 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:47 devstack sudo[90492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.b9948125-2a68-484b-9b81-6002acc53983
Sep 28 18:06:47 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:47 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-00d45474-b20c-4814-b387-115d9a51bc1b tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.b9948125-2a68-484b-9b81-6002acc53983" returned: 0 in 0.446s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:47 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-00d45474-b20c-4814-b387-115d9a51bc1b tempest-SnapshotsActionsTest-1607129491 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.b9948125-2a68-484b-9b81-6002acc53983 is being set with open permissions: ugo+rw
Sep 28 18:06:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-00d45474-b20c-4814-b387-115d9a51bc1b tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.b9948125-2a68-484b-9b81-6002acc53983 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:47 devstack sudo[90498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.b9948125-2a68-484b-9b81-6002acc53983
Sep 28 18:06:47 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:48 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-00d45474-b20c-4814-b387-115d9a51bc1b tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.b9948125-2a68-484b-9b81-6002acc53983" returned: 0 in 0.423s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-00d45474-b20c-4814-b387-115d9a51bc1b tempest-SnapshotsActionsTest-1607129491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.117s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:06:48 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-00d45474-b20c-4814-b387-115d9a51bc1b tempest-SnapshotsActionsTest-1607129491 None] Create snapshot completed successfully
Sep 28 18:06:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] Acquiring lock "cinder-b9948125-2a68-484b-9b81-6002acc53983-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:06:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-b9948125-2a68-484b-9b81-6002acc53983-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:06:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] Acquiring lock "cinder-quobyte-959162d2-e49b-403c-8faf-d3593a6d30c5" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:06:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-quobyte-959162d2-e49b-403c-8faf-d3593a6d30c5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:06:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] Acquiring lock "cinder-quobyte-b9948125-2a68-484b-9b81-6002acc53983" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:06:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-quobyte-b9948125-2a68-484b-9b81-6002acc53983" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:06:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] Deleting offline snapshot b9948125-2a68-484b-9b81-6002acc53983 of volume 959162d2-e49b-403c-8faf-d3593a6d30c5 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:06:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] snapshot_file for this snap is: volume-959162d2-e49b-403c-8faf-d3593a6d30c5.b9948125-2a68-484b-9b81-6002acc53983 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:06:49 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18222a3-0d32-4d13-af42-351ef89b2f76]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:06:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.b9948125-2a68-484b-9b81-6002acc53983 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:49 devstack sudo[90504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.b9948125-2a68-484b-9b81-6002acc53983
Sep 28 18:06:49 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:50 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.b9948125-2a68-484b-9b81-6002acc53983" returned: 0 in 0.477s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-959162d2-e49b-403c-8faf-d3593a6d30c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:06:50 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[61083cd1-4b8b-4ab0-8253-72f0a682745b]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:06:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:50 devstack sudo[90511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0
Sep 28 18:06:50 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:50 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0" returned: 0 in 0.471s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-959162d2-e49b-403c-8faf-d3593a6d30c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:06:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.b9948125-2a68-484b-9b81-6002acc53983 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:50 devstack sudo[90517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.b9948125-2a68-484b-9b81-6002acc53983
Sep 28 18:06:50 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:51 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.b9948125-2a68-484b-9b81-6002acc53983" returned: 0 in 0.538s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.b9948125-2a68-484b-9b81-6002acc53983 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:51 devstack sudo[90526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.b9948125-2a68-484b-9b81-6002acc53983
Sep 28 18:06:51 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:51 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.b9948125-2a68-484b-9b81-6002acc53983" returned: 0 in 0.393s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-quobyte-b9948125-2a68-484b-9b81-6002acc53983" released by "_delete_snapshot" :: held 2.049s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:06:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-quobyte-959162d2-e49b-403c-8faf-d3593a6d30c5" released by "delete_snapshot" :: held 2.097s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:06:51 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] Created reservations ['d0b75457-3ed1-41d8-a892-67ae229e5641', '07fe7377-5662-4061-b5ba-7e62ab3358de', '53357170-bf2b-41fc-854c-3d2a53819e1c', 'df175469-16cc-478a-b6cc-81e85a5b1c6b'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:06:51 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] Delete snapshot completed successfully.
Sep 28 18:06:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-551665d5-530c-478a-8da5-4321a5c8eb8c tempest-SnapshotsActionsTest-1122274252 None] Lock "cinder-b9948125-2a68-484b-9b81-6002acc53983-delete_snapshot" released by "delete_snapshot" :: held 2.376s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:06:53 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c7dd72a5-5b4d-41b1-85c1-8edc72b3594e tempest-SnapshotsActionsTest-1607129491 None] Acquiring lock "cinder-f982fbef-65a7-49d0-acb4-611b12ddb6e0-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:06:53 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c7dd72a5-5b4d-41b1-85c1-8edc72b3594e tempest-SnapshotsActionsTest-1607129491 None] Lock "cinder-f982fbef-65a7-49d0-acb4-611b12ddb6e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:06:53 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c7dd72a5-5b4d-41b1-85c1-8edc72b3594e tempest-SnapshotsActionsTest-1607129491 None] Acquiring lock "cinder-quobyte-959162d2-e49b-403c-8faf-d3593a6d30c5" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:06:53 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c7dd72a5-5b4d-41b1-85c1-8edc72b3594e tempest-SnapshotsActionsTest-1607129491 None] Lock "cinder-quobyte-959162d2-e49b-403c-8faf-d3593a6d30c5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:06:53 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c7dd72a5-5b4d-41b1-85c1-8edc72b3594e tempest-SnapshotsActionsTest-1607129491 None] Acquiring lock "cinder-quobyte-f982fbef-65a7-49d0-acb4-611b12ddb6e0" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:06:53 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c7dd72a5-5b4d-41b1-85c1-8edc72b3594e tempest-SnapshotsActionsTest-1607129491 None] Lock "cinder-quobyte-f982fbef-65a7-49d0-acb4-611b12ddb6e0" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:06:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-c7dd72a5-5b4d-41b1-85c1-8edc72b3594e tempest-SnapshotsActionsTest-1607129491 None] Deleting offline snapshot f982fbef-65a7-49d0-acb4-611b12ddb6e0 of volume 959162d2-e49b-403c-8faf-d3593a6d30c5 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:06:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-c7dd72a5-5b4d-41b1-85c1-8edc72b3594e tempest-SnapshotsActionsTest-1607129491 None] snapshot_file for this snap is: volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:06:53 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0dca72-2920-4028-8f94-6a0b34133d57]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:06:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c7dd72a5-5b4d-41b1-85c1-8edc72b3594e tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:53 devstack sudo[90543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0
Sep 28 18:06:53 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:54 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c7dd72a5-5b4d-41b1-85c1-8edc72b3594e tempest-SnapshotsActionsTest-1607129491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0" returned: 0 in 0.624s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:54 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-c7dd72a5-5b4d-41b1-85c1-8edc72b3594e tempest-SnapshotsActionsTest-1607129491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-959162d2-e49b-403c-8faf-d3593a6d30c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:06:54 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2d6da0-dd2d-46ab-a23d-d06b66d31a80]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:06:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c7dd72a5-5b4d-41b1-85c1-8edc72b3594e tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:54 devstack sudo[90550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5
Sep 28 18:06:54 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:54 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c7dd72a5-5b4d-41b1-85c1-8edc72b3594e tempest-SnapshotsActionsTest-1607129491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5" returned: 0 in 0.742s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c7dd72a5-5b4d-41b1-85c1-8edc72b3594e tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:54 devstack sudo[90567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0
Sep 28 18:06:54 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:55 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c7dd72a5-5b4d-41b1-85c1-8edc72b3594e tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0" returned: 0 in 0.822s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c7dd72a5-5b4d-41b1-85c1-8edc72b3594e tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:55 devstack sudo[90610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0
Sep 28 18:06:55 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:56 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c7dd72a5-5b4d-41b1-85c1-8edc72b3594e tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5.f982fbef-65a7-49d0-acb4-611b12ddb6e0" returned: 0 in 0.637s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c7dd72a5-5b4d-41b1-85c1-8edc72b3594e tempest-SnapshotsActionsTest-1607129491 None] Lock "cinder-quobyte-f982fbef-65a7-49d0-acb4-611b12ddb6e0" released by "_delete_snapshot" :: held 3.041s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:06:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c7dd72a5-5b4d-41b1-85c1-8edc72b3594e tempest-SnapshotsActionsTest-1607129491 None] Lock "cinder-quobyte-959162d2-e49b-403c-8faf-d3593a6d30c5" released by "delete_snapshot" :: held 3.092s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:06:56 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-c7dd72a5-5b4d-41b1-85c1-8edc72b3594e tempest-SnapshotsActionsTest-1607129491 None] Created reservations ['3cd07f60-1efd-466d-949c-13ba71e9a92b', '92c933aa-14c9-49b2-be1f-7d26cbe372fe', '3f388039-c2ac-4db3-befd-e8927e280a56', 'fc26c63b-7a0a-4e7f-93b9-8e4c5913d900'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:06:56 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-c7dd72a5-5b4d-41b1-85c1-8edc72b3594e tempest-SnapshotsActionsTest-1607129491 None] Delete snapshot completed successfully.
Sep 28 18:06:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c7dd72a5-5b4d-41b1-85c1-8edc72b3594e tempest-SnapshotsActionsTest-1607129491 None] Lock "cinder-f982fbef-65a7-49d0-acb4-611b12ddb6e0-delete_snapshot" released by "delete_snapshot" :: held 3.357s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:06:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6da7b282-71ad-49b8-8ea3-a9d7dbc9193f tempest-SnapshotsActionsTest-1607129491 None] Acquiring lock "cinder-959162d2-e49b-403c-8faf-d3593a6d30c5-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:06:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6da7b282-71ad-49b8-8ea3-a9d7dbc9193f tempest-SnapshotsActionsTest-1607129491 None] Lock "cinder-959162d2-e49b-403c-8faf-d3593a6d30c5-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:06:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6da7b282-71ad-49b8-8ea3-a9d7dbc9193f tempest-SnapshotsActionsTest-1607129491 None] Acquiring lock "cinder-quobyte-959162d2-e49b-403c-8faf-d3593a6d30c5" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:06:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6da7b282-71ad-49b8-8ea3-a9d7dbc9193f tempest-SnapshotsActionsTest-1607129491 None] Lock "cinder-quobyte-959162d2-e49b-403c-8faf-d3593a6d30c5" acquired by "delete_volume" :: waited 0.023s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:06:57 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[502c550e-5a7f-4b86-a209-38237f9d9416]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:06:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6da7b282-71ad-49b8-8ea3-a9d7dbc9193f tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:57 devstack sudo[90647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5
Sep 28 18:06:57 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:57 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6da7b282-71ad-49b8-8ea3-a9d7dbc9193f tempest-SnapshotsActionsTest-1607129491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5" returned: 0 in 0.553s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6da7b282-71ad-49b8-8ea3-a9d7dbc9193f tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:57 devstack sudo[90663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5
Sep 28 18:06:57 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:58 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6da7b282-71ad-49b8-8ea3-a9d7dbc9193f tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-959162d2-e49b-403c-8faf-d3593a6d30c5" returned: 0 in 0.460s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6da7b282-71ad-49b8-8ea3-a9d7dbc9193f tempest-SnapshotsActionsTest-1607129491 None] Lock "cinder-quobyte-959162d2-e49b-403c-8faf-d3593a6d30c5" released by "delete_volume" :: held 1.161s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:06:58 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-6da7b282-71ad-49b8-8ea3-a9d7dbc9193f tempest-SnapshotsActionsTest-1607129491 None] Created reservations ['09f34af4-6b3c-44ea-b1bc-e36101c9de84', 'd9674dc6-487b-42e2-882f-ec61f5ab24c0', 'f8656ef9-5ecd-418b-87cd-f715af51d2ec', 'c6822f88-6594-4763-86e2-867619af976b'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:06:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6da7b282-71ad-49b8-8ea3-a9d7dbc9193f tempest-SnapshotsActionsTest-1607129491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:06:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6da7b282-71ad-49b8-8ea3-a9d7dbc9193f tempest-SnapshotsActionsTest-1607129491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:06:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6da7b282-71ad-49b8-8ea3-a9d7dbc9193f tempest-SnapshotsActionsTest-1607129491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:06:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6da7b282-71ad-49b8-8ea3-a9d7dbc9193f tempest-SnapshotsActionsTest-1607129491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:06:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6da7b282-71ad-49b8-8ea3-a9d7dbc9193f tempest-SnapshotsActionsTest-1607129491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:06:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6da7b282-71ad-49b8-8ea3-a9d7dbc9193f tempest-SnapshotsActionsTest-1607129491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:06:58 devstack sudo[90679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:06:58 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:06:59 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root
Sep 28 18:06:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6da7b282-71ad-49b8-8ea3-a9d7dbc9193f tempest-SnapshotsActionsTest-1607129491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.571s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:06:59 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-6da7b282-71ad-49b8-8ea3-a9d7dbc9193f tempest-SnapshotsActionsTest-1607129491 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:06:59 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-6da7b282-71ad-49b8-8ea3-a9d7dbc9193f tempest-SnapshotsActionsTest-1607129491 None] Deleted volume successfully.
Sep 28 18:06:59 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6da7b282-71ad-49b8-8ea3-a9d7dbc9193f tempest-SnapshotsActionsTest-1607129491 None] Lock "cinder-959162d2-e49b-403c-8faf-d3593a6d30c5-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:07:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-697eb016-eaf3-4197-bf6c-f03946bc4ba7 req-d497c144-223b-4306-a6bb-c49f09de33ad tempest-ServerActionsTestOtherA-595876003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:07:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-697eb016-eaf3-4197-bf6c-f03946bc4ba7 req-d497c144-223b-4306-a6bb-c49f09de33ad tempest-ServerActionsTestOtherA-595876003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:07:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-697eb016-eaf3-4197-bf6c-f03946bc4ba7 req-d497c144-223b-4306-a6bb-c49f09de33ad tempest-ServerActionsTestOtherA-595876003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:07:03 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-697eb016-eaf3-4197-bf6c-f03946bc4ba7 req-d497c144-223b-4306-a6bb-c49f09de33ad tempest-ServerActionsTestOtherA-595876003 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-a35b8afa-22e2-4558-99d6-cc212fa9b2f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d5b36a7-7c9b-4a63-ac14-9326799aba2a', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:07:03 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-697eb016-eaf3-4197-bf6c-f03946bc4ba7 req-d497c144-223b-4306-a6bb-c49f09de33ad tempest-ServerActionsTestOtherA-595876003 None] attachment_update completed successfully.
Sep 28 18:07:13 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=55,cinder:UPDATE=52,cinder:INSERT=16,cinder:DELETE=7 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:07:13 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:UPDATE=62,cinder:SELECT=63,cinder:INSERT=15,cinder:DELETE=2 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:07:13 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-77c692c1-64a4-442a-8235-06512d22848d req-554dd0a7-e132-4183-a116-44d2302e6f75 tempest-ServerActionsTestOtherA-595876003 None] Terminate volume connection completed successfully.
Sep 28 18:07:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-77c692c1-64a4-442a-8235-06512d22848d req-554dd0a7-e132-4183-a116-44d2302e6f75 tempest-ServerActionsTestOtherA-595876003 None] Deleting attachment 3d5b36a7-7c9b-4a63-ac14-9326799aba2a. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:07:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-77c692c1-64a4-442a-8235-06512d22848d req-f3af8341-6612-4f70-8725-b004b8ea576c tempest-ServerActionsTestOtherA-595876003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:07:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-77c692c1-64a4-442a-8235-06512d22848d req-f3af8341-6612-4f70-8725-b004b8ea576c tempest-ServerActionsTestOtherA-595876003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:07:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-77c692c1-64a4-442a-8235-06512d22848d req-f3af8341-6612-4f70-8725-b004b8ea576c tempest-ServerActionsTestOtherA-595876003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:07:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-77c692c1-64a4-442a-8235-06512d22848d req-f3af8341-6612-4f70-8725-b004b8ea576c tempest-ServerActionsTestOtherA-595876003 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-a35b8afa-22e2-4558-99d6-cc212fa9b2f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd15c2158-e309-46d9-bff3-e3d77bf4ff26', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:07:14 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-77c692c1-64a4-442a-8235-06512d22848d req-f3af8341-6612-4f70-8725-b004b8ea576c tempest-ServerActionsTestOtherA-595876003 None] attachment_update completed successfully.
Sep 28 18:07:24 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:07:24 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Flow 'volume_create_manager' (6344c32e-a95f-4a44-91ad-d76e0d0be52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7160a05-a109-42eb-8059-7200b1adeced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7160a05-a109-42eb-8059-7200b1adeced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-58773737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9dd3fa-8553-4353-87d0-3ccafd3af6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d5383fd047f4b998e9e8b1a1bcf58da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:30Z,use_quota=True,user_id='68559e90c99044d09b706bfc5d23973b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e14e39f1-5e4a-4664-97e8-e041664e3a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e14e39f1-5e4a-4664-97e8-e041664e3a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f7bc5b-46c9-4708-b973-607916137922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f7bc5b-46c9-4708-b973-607916137922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d9dd3fa-8553-4353-87d0-3ccafd3af6cc', 'volume_name': 'volume-1d9dd3fa-8553-4353-87d0-3ccafd3af6cc', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28691adf-0987-4a5a-b09c-6e04910dc46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28691adf-0987-4a5a-b09c-6e04910dc46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf7e1d0f-38b8-40a7-8ecd-58a3e625474d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:07:30 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Volume 1d9dd3fa-8553-4353-87d0-3ccafd3af6cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d9dd3fa-8553-4353-87d0-3ccafd3af6cc', 'volume_size': 1}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-58773737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9dd3fa-8553-4353-87d0-3ccafd3af6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d5383fd047f4b998e9e8b1a1bcf58da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:30Z,use_quota=True,user_id='68559e90c99044d09b706bfc5d23973b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Creating volume 1d9dd3fa-8553-4353-87d0-3ccafd3af6cc {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:07:30 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d9dd3fa-8553-4353-87d0-3ccafd3af6cc 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:07:30 devstack sudo[91911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d9dd3fa-8553-4353-87d0-3ccafd3af6cc 1073741824
Sep 28 18:07:30 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Flow 'volume_create_manager' (ed967e16-4a1e-404e-833c-2dd7e5e0446f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:07:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2213ccb4-93b6-4174-9279-367b6da0295f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:07:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2213ccb4-93b6-4174-9279-367b6da0295f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1078999890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c53dfa779c048109c5ec9a496b5af21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:31Z,use_quota=True,user_id='cbee9dcd20584cf288915233838961d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:07:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4558d50-0741-4de3-a69c-1df4e67ecc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:07:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4558d50-0741-4de3-a69c-1df4e67ecc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:07:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57537a71-e06c-4a0e-bc9a-7ba21ce01c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:07:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57537a71-e06c-4a0e-bc9a-7ba21ce01c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa', 'volume_name': 'volume-78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:07:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6886ddf0-b6e5-4fea-9209-c0af94952761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:07:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6886ddf0-b6e5-4fea-9209-c0af94952761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:07:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37d3fbb-091f-4e39-bafd-58c2064d918f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:07:31 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Volume 78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa', 'volume_size': 1}
Sep 28 18:07:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:07:31 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root
Sep 28 18:07:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d9dd3fa-8553-4353-87d0-3ccafd3af6cc 1073741824" returned: 0 in 1.133s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:07:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d9dd3fa-8553-4353-87d0-3ccafd3af6cc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:07:31 devstack sudo[91949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d9dd3fa-8553-4353-87d0-3ccafd3af6cc
Sep 28 18:07:31 devstack sudo[91949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:07:32 devstack sudo[91949]: pam_unix(sudo:session): session closed for user root
Sep 28 18:07:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d9dd3fa-8553-4353-87d0-3ccafd3af6cc" returned: 0 in 0.873s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:07:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] <== create_volume: return (2103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:07:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.109s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:07:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.289s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:07:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1078999890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c53dfa779c048109c5ec9a496b5af21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:31Z,use_quota=True,user_id='cbee9dcd20584cf288915233838961d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:07:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Creating volume 78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:07:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:07:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:07:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:07:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:07:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:07:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:07:32 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:07:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:07:32 devstack sudo[91980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa 1073741824
Sep 28 18:07:32 devstack sudo[91980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:07:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf7e1d0f-38b8-40a7-8ecd-58a3e625474d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d9dd3fa-8553-4353-87d0-3ccafd3af6cc', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:07:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9519ffd-9d0c-424c-8874-70b876890fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:07:32 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Volume volume-1d9dd3fa-8553-4353-87d0-3ccafd3af6cc (1d9dd3fa-8553-4353-87d0-3ccafd3af6cc): created successfully
Sep 28 18:07:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9519ffd-9d0c-424c-8874-70b876890fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:07:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Flow 'volume_create_manager' (6344c32e-a95f-4a44-91ad-d76e0d0be52f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:07:32 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-30fc2bb4-5553-4a84-8a54-3ddcca60954c tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Created volume successfully.
Sep 28 18:07:33 devstack sudo[91980]: pam_unix(sudo:session): session closed for user root
Sep 28 18:07:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa 1073741824" returned: 0 in 0.804s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:07:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:07:33 devstack sudo[92009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa
Sep 28 18:07:33 devstack sudo[92009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:07:33 devstack sudo[92009]: pam_unix(sudo:session): session closed for user root
Sep 28 18:07:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa" returned: 0 in 0.316s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:07:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:07:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:07:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37d3fbb-091f-4e39-bafd-58c2064d918f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:07:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664c48ac-773b-4677-ac79-5b6101164862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:07:33 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Volume volume-78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa (78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa): created successfully
Sep 28 18:07:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664c48ac-773b-4677-ac79-5b6101164862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:07:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Flow 'volume_create_manager' (ed967e16-4a1e-404e-833c-2dd7e5e0446f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:07:33 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-06d87bff-0e2d-456e-a8e0-ede6ebca8a29 tempest-ServersNegativeTestJSON-865949820 None] Created volume successfully.
Sep 28 18:07:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-39510af8-905f-484e-8f2f-9529581b34a5 tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Acquiring lock "cinder-1d9dd3fa-8553-4353-87d0-3ccafd3af6cc-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:07:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-39510af8-905f-484e-8f2f-9529581b34a5 tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Lock "cinder-1d9dd3fa-8553-4353-87d0-3ccafd3af6cc-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:07:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-39510af8-905f-484e-8f2f-9529581b34a5 tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Acquiring lock "cinder-quobyte-1d9dd3fa-8553-4353-87d0-3ccafd3af6cc" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:07:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-39510af8-905f-484e-8f2f-9529581b34a5 tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Lock "cinder-quobyte-1d9dd3fa-8553-4353-87d0-3ccafd3af6cc" acquired by "delete_volume" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:07:35 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e689ed-5ad0-4ec0-889d-98c170f6790f]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:07:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-39510af8-905f-484e-8f2f-9529581b34a5 tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d9dd3fa-8553-4353-87d0-3ccafd3af6cc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:07:35 devstack sudo[92015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d9dd3fa-8553-4353-87d0-3ccafd3af6cc
Sep 28 18:07:35 devstack sudo[92015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:07:35 devstack sudo[92015]: pam_unix(sudo:session): session closed for user root
Sep 28 18:07:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-39510af8-905f-484e-8f2f-9529581b34a5 tempest-VolumeQuotasNegativeTestJSON-1376945936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d9dd3fa-8553-4353-87d0-3ccafd3af6cc" returned: 0 in 0.463s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:07:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-39510af8-905f-484e-8f2f-9529581b34a5 tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d9dd3fa-8553-4353-87d0-3ccafd3af6cc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:07:35 devstack sudo[92021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d9dd3fa-8553-4353-87d0-3ccafd3af6cc
Sep 28 18:07:35 devstack sudo[92021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:07:36 devstack sudo[92021]: pam_unix(sudo:session): session closed for user root
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-39510af8-905f-484e-8f2f-9529581b34a5 tempest-VolumeQuotasNegativeTestJSON-1376945936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d9dd3fa-8553-4353-87d0-3ccafd3af6cc" returned: 0 in 0.584s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-39510af8-905f-484e-8f2f-9529581b34a5 tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Lock "cinder-quobyte-1d9dd3fa-8553-4353-87d0-3ccafd3af6cc" released by "delete_volume" :: held 1.120s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-39510af8-905f-484e-8f2f-9529581b34a5 tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Created reservations ['8af6651c-469c-423a-b3e7-05cf02d6b55a', 'f6389afd-bacc-41fa-9ce0-827a78b1bd48', '61073a90-c786-4f8b-869a-9dbedec3babd', '65569f98-c148-430b-8d1a-4a8b4e7f9b52'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Flow 'volume_create_manager' (8cd238e7-0340-4cd9-ad75-42fa6ef315da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc54b34-3348-4078-9ee9-2f1b6bb7e1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc54b34-3348-4078-9ee9-2f1b6bb7e1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-26778345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45534763-5fc1-4bef-81c3-bfe57b6df7a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c53dfa779c048109c5ec9a496b5af21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:37Z,use_quota=True,user_id='cbee9dcd20584cf288915233838961d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e33772-c304-4f35-bb80-eb1ed5355ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e33772-c304-4f35-bb80-eb1ed5355ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19f08e6f-bcd7-48aa-b949-e4e41d3b9a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19f08e6f-bcd7-48aa-b949-e4e41d3b9a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45534763-5fc1-4bef-81c3-bfe57b6df7a5', 'volume_name': 'volume-45534763-5fc1-4bef-81c3-bfe57b6df7a5', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2858144-27c6-4e6f-be7f-939e2da175c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2858144-27c6-4e6f-be7f-939e2da175c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d76e6a5-bde9-4cd0-864e-f798f34090bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:07:36 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Volume 45534763-5fc1-4bef-81c3-bfe57b6df7a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45534763-5fc1-4bef-81c3-bfe57b6df7a5', 'volume_size': 1}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-26778345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45534763-5fc1-4bef-81c3-bfe57b6df7a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c53dfa779c048109c5ec9a496b5af21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:37Z,use_quota=True,user_id='cbee9dcd20584cf288915233838961d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Creating volume 45534763-5fc1-4bef-81c3-bfe57b6df7a5 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:07:36 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:07:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45534763-5fc1-4bef-81c3-bfe57b6df7a5 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:07:36 devstack sudo[92048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45534763-5fc1-4bef-81c3-bfe57b6df7a5 1073741824
Sep 28 18:07:36 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:07:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-39510af8-905f-484e-8f2f-9529581b34a5 tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:07:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-39510af8-905f-484e-8f2f-9529581b34a5 tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:07:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-39510af8-905f-484e-8f2f-9529581b34a5 tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:07:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-39510af8-905f-484e-8f2f-9529581b34a5 tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:07:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-39510af8-905f-484e-8f2f-9529581b34a5 tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:07:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-39510af8-905f-484e-8f2f-9529581b34a5 tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:07:37 devstack sudo[92050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:07:37 devstack sudo[92050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:07:37 devstack sudo[92050]: pam_unix(sudo:session): session closed for user root
Sep 28 18:07:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-39510af8-905f-484e-8f2f-9529581b34a5 tempest-VolumeQuotasNegativeTestJSON-1376945936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.479s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:07:37 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-39510af8-905f-484e-8f2f-9529581b34a5 tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:07:37 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-39510af8-905f-484e-8f2f-9529581b34a5 tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Deleted volume successfully.
Sep 28 18:07:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-39510af8-905f-484e-8f2f-9529581b34a5 tempest-VolumeQuotasNegativeTestJSON-1376945936 None] Lock "cinder-1d9dd3fa-8553-4353-87d0-3ccafd3af6cc-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:07:38 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root
Sep 28 18:07:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45534763-5fc1-4bef-81c3-bfe57b6df7a5 1073741824" returned: 0 in 1.191s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:07:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45534763-5fc1-4bef-81c3-bfe57b6df7a5 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:07:38 devstack sudo[92082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45534763-5fc1-4bef-81c3-bfe57b6df7a5
Sep 28 18:07:38 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:07:39 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root
Sep 28 18:07:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45534763-5fc1-4bef-81c3-bfe57b6df7a5" returned: 0 in 0.920s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:07:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] <== create_volume: return (2206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:07:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.214s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:07:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d76e6a5-bde9-4cd0-864e-f798f34090bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45534763-5fc1-4bef-81c3-bfe57b6df7a5', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:07:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a73382b-93c1-4f81-a134-4c9a77591dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:07:39 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Volume volume-45534763-5fc1-4bef-81c3-bfe57b6df7a5 (45534763-5fc1-4bef-81c3-bfe57b6df7a5): created successfully
Sep 28 18:07:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a73382b-93c1-4f81-a134-4c9a77591dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:07:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Flow 'volume_create_manager' (8cd238e7-0340-4cd9-ad75-42fa6ef315da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:07:39 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-15c82314-8b43-423c-a174-7f1d3fba965e tempest-ServersNegativeTestJSON-865949820 None] Created volume successfully.
Sep 28 18:07:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:07:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:07:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:07:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:07:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:07:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:07:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:07:39 devstack sudo[92088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:07:39 devstack sudo[92088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:07:39 devstack sudo[92088]: pam_unix(sudo:session): session closed for user root
Sep 28 18:07:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.322s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:07:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:07:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:07:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 8 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:07:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:07:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-39de8768-2a39-4d69-99ac-afd8848a1f37 tempest-ServersNegativeTestJSON-865949820 None] Acquiring lock "cinder-45534763-5fc1-4bef-81c3-bfe57b6df7a5-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:07:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-39de8768-2a39-4d69-99ac-afd8848a1f37 tempest-ServersNegativeTestJSON-865949820 None] Lock "cinder-45534763-5fc1-4bef-81c3-bfe57b6df7a5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:07:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-39de8768-2a39-4d69-99ac-afd8848a1f37 tempest-ServersNegativeTestJSON-865949820 None] Acquiring lock "cinder-quobyte-45534763-5fc1-4bef-81c3-bfe57b6df7a5" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:07:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-39de8768-2a39-4d69-99ac-afd8848a1f37 tempest-ServersNegativeTestJSON-865949820 None] Lock "cinder-quobyte-45534763-5fc1-4bef-81c3-bfe57b6df7a5" acquired by "delete_volume" :: waited 0.023s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:07:40 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cb9b5b-27ba-4d21-89da-2496e4ece0bb]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:07:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-39de8768-2a39-4d69-99ac-afd8848a1f37 tempest-ServersNegativeTestJSON-865949820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45534763-5fc1-4bef-81c3-bfe57b6df7a5 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:07:40 devstack sudo[92091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45534763-5fc1-4bef-81c3-bfe57b6df7a5
Sep 28 18:07:40 devstack sudo[92091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:07:41 devstack sudo[92091]: pam_unix(sudo:session): session closed for user root
Sep 28 18:07:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-39de8768-2a39-4d69-99ac-afd8848a1f37 tempest-ServersNegativeTestJSON-865949820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45534763-5fc1-4bef-81c3-bfe57b6df7a5" returned: 0 in 0.535s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:07:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-39de8768-2a39-4d69-99ac-afd8848a1f37 tempest-ServersNegativeTestJSON-865949820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45534763-5fc1-4bef-81c3-bfe57b6df7a5 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:07:41 devstack sudo[92096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45534763-5fc1-4bef-81c3-bfe57b6df7a5
Sep 28 18:07:41 devstack sudo[92096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:07:41 devstack sudo[92096]: pam_unix(sudo:session): session closed for user root
Sep 28 18:07:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-39de8768-2a39-4d69-99ac-afd8848a1f37 tempest-ServersNegativeTestJSON-865949820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45534763-5fc1-4bef-81c3-bfe57b6df7a5" returned: 0 in 0.323s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:07:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-39de8768-2a39-4d69-99ac-afd8848a1f37 tempest-ServersNegativeTestJSON-865949820 None] Lock "cinder-quobyte-45534763-5fc1-4bef-81c3-bfe57b6df7a5" released by "delete_volume" :: held 0.913s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:07:41 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-39de8768-2a39-4d69-99ac-afd8848a1f37 tempest-ServersNegativeTestJSON-865949820 None] Created reservations ['64da1665-60c9-4879-aa07-62a32f2a943a', 'e48b6b49-6d13-4bc7-aa39-b30daecddc37', '0774dee3-b7f7-4195-acdd-938dd6461f19', 'f418cf1a-7370-4c7c-9b79-0eb079aeb083'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:07:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-39de8768-2a39-4d69-99ac-afd8848a1f37 tempest-ServersNegativeTestJSON-865949820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:07:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-39de8768-2a39-4d69-99ac-afd8848a1f37 tempest-ServersNegativeTestJSON-865949820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:07:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-39de8768-2a39-4d69-99ac-afd8848a1f37 tempest-ServersNegativeTestJSON-865949820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:07:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-39de8768-2a39-4d69-99ac-afd8848a1f37 tempest-ServersNegativeTestJSON-865949820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:07:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-39de8768-2a39-4d69-99ac-afd8848a1f37 tempest-ServersNegativeTestJSON-865949820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:07:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-39de8768-2a39-4d69-99ac-afd8848a1f37 tempest-ServersNegativeTestJSON-865949820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:07:41 devstack sudo[92099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:07:41 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:07:42 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root
Sep 28 18:07:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-39de8768-2a39-4d69-99ac-afd8848a1f37 tempest-ServersNegativeTestJSON-865949820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.400s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:07:42 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-39de8768-2a39-4d69-99ac-afd8848a1f37 tempest-ServersNegativeTestJSON-865949820 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:07:42 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-39de8768-2a39-4d69-99ac-afd8848a1f37 tempest-ServersNegativeTestJSON-865949820 None] Deleted volume successfully.
Sep 28 18:07:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-39de8768-2a39-4d69-99ac-afd8848a1f37 tempest-ServersNegativeTestJSON-865949820 None] Lock "cinder-45534763-5fc1-4bef-81c3-bfe57b6df7a5-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:07:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c4ed2923-63c1-4e72-a2f4-30a187234464 tempest-ServersNegativeTestJSON-865949820 None] Acquiring lock "cinder-78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:07:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c4ed2923-63c1-4e72-a2f4-30a187234464 tempest-ServersNegativeTestJSON-865949820 None] Lock "cinder-78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:07:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c4ed2923-63c1-4e72-a2f4-30a187234464 tempest-ServersNegativeTestJSON-865949820 None] Acquiring lock "cinder-quobyte-78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:07:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c4ed2923-63c1-4e72-a2f4-30a187234464 tempest-ServersNegativeTestJSON-865949820 None] Lock "cinder-quobyte-78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa" acquired by "delete_volume" :: waited 0.024s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:07:43 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a8685b-d543-4afd-ba2d-e3b4cdfeef50]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:07:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c4ed2923-63c1-4e72-a2f4-30a187234464 tempest-ServersNegativeTestJSON-865949820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:07:43 devstack sudo[92103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa
Sep 28 18:07:43 devstack sudo[92103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:07:43 devstack sudo[92103]: pam_unix(sudo:session): session closed for user root
Sep 28 18:07:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c4ed2923-63c1-4e72-a2f4-30a187234464 tempest-ServersNegativeTestJSON-865949820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa" returned: 0 in 0.470s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:07:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c4ed2923-63c1-4e72-a2f4-30a187234464 tempest-ServersNegativeTestJSON-865949820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:07:43 devstack sudo[92109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa
Sep 28 18:07:43 devstack sudo[92109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:07:43 devstack sudo[92109]: pam_unix(sudo:session): session closed for user root
Sep 28 18:07:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c4ed2923-63c1-4e72-a2f4-30a187234464 tempest-ServersNegativeTestJSON-865949820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa" returned: 0 in 0.334s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:07:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c4ed2923-63c1-4e72-a2f4-30a187234464 tempest-ServersNegativeTestJSON-865949820 None] Lock "cinder-quobyte-78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa" released by "delete_volume" :: held 0.859s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:07:43 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-c4ed2923-63c1-4e72-a2f4-30a187234464 tempest-ServersNegativeTestJSON-865949820 None] Created reservations ['73238106-2d9b-4866-83ea-2495399267df', 'a3fefb06-ba5c-409a-9607-2ffb8c969f09', 'cc3a1230-c19a-4dfa-b67a-7a5369bc5907', '1bf75d37-6733-4629-b8d0-af671680f9fe'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:07:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c4ed2923-63c1-4e72-a2f4-30a187234464 tempest-ServersNegativeTestJSON-865949820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:07:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c4ed2923-63c1-4e72-a2f4-30a187234464 tempest-ServersNegativeTestJSON-865949820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:07:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c4ed2923-63c1-4e72-a2f4-30a187234464 tempest-ServersNegativeTestJSON-865949820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:07:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c4ed2923-63c1-4e72-a2f4-30a187234464 tempest-ServersNegativeTestJSON-865949820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:07:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c4ed2923-63c1-4e72-a2f4-30a187234464 tempest-ServersNegativeTestJSON-865949820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:07:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c4ed2923-63c1-4e72-a2f4-30a187234464 tempest-ServersNegativeTestJSON-865949820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:07:44 devstack sudo[92112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:07:44 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:07:44 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root
Sep 28 18:07:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c4ed2923-63c1-4e72-a2f4-30a187234464 tempest-ServersNegativeTestJSON-865949820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.517s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:07:44 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-c4ed2923-63c1-4e72-a2f4-30a187234464 tempest-ServersNegativeTestJSON-865949820 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:07:44 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-c4ed2923-63c1-4e72-a2f4-30a187234464 tempest-ServersNegativeTestJSON-865949820 None] Deleted volume successfully.
Sep 28 18:07:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c4ed2923-63c1-4e72-a2f4-30a187234464 tempest-ServersNegativeTestJSON-865949820 None] Lock "cinder-78cc2a18-0bb6-44d9-a5c6-2af5cb662cfa-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:07:53 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-c56dd6bb-b09b-4e52-b80c-729773f81121 req-bab42ef6-9b90-445c-94c3-318b4243c660 tempest-ServerActionsTestOtherA-595876003 None] Terminate volume connection completed successfully.
Sep 28 18:07:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-c56dd6bb-b09b-4e52-b80c-729773f81121 req-bab42ef6-9b90-445c-94c3-318b4243c660 tempest-ServerActionsTestOtherA-595876003 None] Deleting attachment d15c2158-e309-46d9-bff3-e3d77bf4ff26. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:08:00 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:08:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Flow 'volume_create_manager' (86428351-2fee-45d9-a219-3eaad0b79405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:08:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2c573f-df29-4114-8fce-35d43b7bbeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:08:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2c573f-df29-4114-8fce-35d43b7bbeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1209294846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d09bb376-e5c0-439e-a819-a879e43020a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a99c5ca93a1f4717bc7e21c230adc0e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:00Z,use_quota=True,user_id='64efdcb827d9423eb158550813109e69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:08:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25f506cf-ef77-421e-82d2-34e70d4b92eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:08:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25f506cf-ef77-421e-82d2-34e70d4b92eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:08:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd348d16-d8c2-4279-9021-ee8792301a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:08:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd348d16-d8c2-4279-9021-ee8792301a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd09bb376-e5c0-439e-a819-a879e43020a7', 'volume_name': 'volume-d09bb376-e5c0-439e-a819-a879e43020a7', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:08:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c87cd973-ad7f-4696-bd23-1d9c60ad6ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:08:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c87cd973-ad7f-4696-bd23-1d9c60ad6ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:08:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb14039-031a-4dcc-8999-5598ab463aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:08:00 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Volume d09bb376-e5c0-439e-a819-a879e43020a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d09bb376-e5c0-439e-a819-a879e43020a7', 'volume_size': 1}
Sep 28 18:08:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:08:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:08:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1209294846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d09bb376-e5c0-439e-a819-a879e43020a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a99c5ca93a1f4717bc7e21c230adc0e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:00Z,use_quota=True,user_id='64efdcb827d9423eb158550813109e69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:08:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Creating volume d09bb376-e5c0-439e-a819-a879e43020a7 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:08:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:08:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:08:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:08:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:08:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:08:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:08:00 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:08:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d09bb376-e5c0-439e-a819-a879e43020a7 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:08:00 devstack sudo[92235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d09bb376-e5c0-439e-a819-a879e43020a7 1073741824
Sep 28 18:08:00 devstack sudo[92235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:08:01 devstack sudo[92235]: pam_unix(sudo:session): session closed for user root
Sep 28 18:08:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d09bb376-e5c0-439e-a819-a879e43020a7 1073741824" returned: 0 in 0.767s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:08:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d09bb376-e5c0-439e-a819-a879e43020a7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:08:01 devstack sudo[92241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d09bb376-e5c0-439e-a819-a879e43020a7
Sep 28 18:08:01 devstack sudo[92241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:08:01 devstack sudo[92241]: pam_unix(sudo:session): session closed for user root
Sep 28 18:08:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d09bb376-e5c0-439e-a819-a879e43020a7" returned: 0 in 0.360s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:08:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:08:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:08:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb14039-031a-4dcc-8999-5598ab463aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d09bb376-e5c0-439e-a819-a879e43020a7', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:08:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb88940f-d23d-4e94-bf4f-5c1e03c91981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:08:01 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Volume volume-d09bb376-e5c0-439e-a819-a879e43020a7 (d09bb376-e5c0-439e-a819-a879e43020a7): created successfully
Sep 28 18:08:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb88940f-d23d-4e94-bf4f-5c1e03c91981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:08:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Flow 'volume_create_manager' (86428351-2fee-45d9-a219-3eaad0b79405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:08:01 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-066dd397-527b-4efd-9ea0-2cf8e00fd009 tempest-AttachVolumeShelveTestJSON-747928854 None] Created volume successfully.
Sep 28 18:08:06 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:08:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Flow 'volume_create_manager' (6aba5298-bead-4cea-86dc-ad2f8749c528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:08:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87931aa2-ca48-497f-8a0d-ecd649c4e2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:08:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87931aa2-ca48-497f-8a0d-ecd649c4e2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-988679165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a65fa9a0-727a-48fb-9a12-efc0784a0df0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc02dbe19adc4c7fa553c9fa2a260d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:06Z,use_quota=True,user_id='ff320b7e01f445cc87f175e8023ef211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:08:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2235ae9c-7edc-4ccb-b310-0056d4085bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:08:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2235ae9c-7edc-4ccb-b310-0056d4085bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:08:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61cf619e-6d38-4789-90f3-00ef4901f5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:08:06 devstack cinder-volume[87046]: DEBUG cinder.image.glance [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Creating Keystone auth plugin from conf {{(pid=87046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 28 18:08:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61cf619e-6d38-4789-90f3-00ef4901f5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a65fa9a0-727a-48fb-9a12-efc0784a0df0', 'volume_name': 'volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0', 'volume_size': 1, 'image_id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de2452cfca174dfbbc7b50b163b23faa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'created_at': datetime.datetime(2026, 9, 28, 15, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 58, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aaedf5550>}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:08:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (371c40c2-6738-4e97-b083-ebcd8b33656b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:08:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (371c40c2-6738-4e97-b083-ebcd8b33656b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:08:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62afd291-9080-4a7d-bed6-ba8ec3efc302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:08:07 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Volume a65fa9a0-727a-48fb-9a12-efc0784a0df0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0', 'volume_size': 1, 'image_id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de2452cfca174dfbbc7b50b163b23faa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'created_at': datetime.datetime(2026, 9, 28, 15, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 58, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aaedf5550>}
Sep 28 18:08:07 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Trying to clone a65fa9a0-727a-48fb-9a12-efc0784a0df0 from image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}]). {{(pid=87046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 28 18:08:08 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_4e_ke273devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 28 18:08:08 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Image download 20.69 MB at 20.69 MB/s
Sep 28 18:08:08 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf65ad4c-a2ea-49f4-b49f-090e3168f84a]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:08:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_4e_ke273devstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:08:08 devstack sudo[92287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_4e_ke273devstack@QuobyteHD
Sep 28 18:08:08 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:08:08 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root
Sep 28 18:08:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_4e_ke273devstack@QuobyteHD" returned: 0 in 0.523s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:08:08 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Temporary image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 is fetched for user ff320b7e01f445cc87f175e8023ef211. {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 28 18:08:09 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfb6958-065b-4c37-82c8-9ba0877ecd5d]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:08:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_4e_ke273devstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:08:09 devstack sudo[92293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_4e_ke273devstack@QuobyteHD
Sep 28 18:08:09 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:08:09 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root
Sep 28 18:08:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_4e_ke273devstack@QuobyteHD" returned: 0 in 0.579s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:08:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:08:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:08:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-988679165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a65fa9a0-727a-48fb-9a12-efc0784a0df0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc02dbe19adc4c7fa553c9fa2a260d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:06Z,use_quota=True,user_id='ff320b7e01f445cc87f175e8023ef211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:08:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Creating volume a65fa9a0-727a-48fb-9a12-efc0784a0df0 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:08:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:08:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:08:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:08:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:08:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:08:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:08:09 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:08:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:08:09 devstack sudo[92299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0 1073741824
Sep 28 18:08:09 devstack sudo[92299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:08:10 devstack sudo[92299]: pam_unix(sudo:session): session closed for user root
Sep 28 18:08:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0 1073741824" returned: 0 in 0.845s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:08:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:08:10 devstack sudo[92305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0
Sep 28 18:08:10 devstack sudo[92305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:08:10 devstack sudo[92305]: pam_unix(sudo:session): session closed for user root
Sep 28 18:08:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0" returned: 0 in 0.312s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:08:10 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:08:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:08:10 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Attempting download of c5b6ff95-792c-4fb0-b8e7-dea90bc76834 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}])) to volume a65fa9a0-727a-48fb-9a12-efc0784a0df0. {{(pid=87046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 28 18:08:11 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf429e85-8bc1-4d8e-a90f-984bdd754e6f]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:08:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_h4as4b76 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:08:11 devstack sudo[92308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_h4as4b76
Sep 28 18:08:11 devstack sudo[92308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:08:11 devstack sudo[92308]: pam_unix(sudo:session): session closed for user root
Sep 28 18:08:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_h4as4b76" returned: 0 in 0.522s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:08:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_h4as4b76 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:08:11 devstack sudo[92312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_h4as4b76
Sep 28 18:08:11 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:08:12 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root
Sep 28 18:08:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_h4as4b76" returned: 1 in 0.471s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:08:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_h4as4b76' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:08:12 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b7c2c8-5515-4fbc-9317-170210174f14]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:08:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_4e_ke273devstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:08:12 devstack sudo[92318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_4e_ke273devstack@QuobyteHD
Sep 28 18:08:12 devstack sudo[92318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:08:12 devstack sudo[92318]: pam_unix(sudo:session): session closed for user root
Sep 28 18:08:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_4e_ke273devstack@QuobyteHD" returned: 0 in 0.455s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:08:12 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] c5b6ff95-792c-4fb0-b8e7-dea90bc76834 was qcow2, converting to qcow2 {{(pid=87046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 28 18:08:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_4e_ke273devstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:08:12 devstack sudo[92327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_4e_ke273devstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0
Sep 28 18:08:12 devstack sudo[92327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:08:15 devstack sudo[92327]: pam_unix(sudo:session): session closed for user root
Sep 28 18:08:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_4e_ke273devstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0" returned: 0 in 3.107s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:08:15 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_4e_ke273devstack@QuobyteHD, size 112.00 MB, duration 3.11 sec, destination /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0 {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:08:15 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Converted 112.00 MB image at 36.01 MB/s
Sep 28 18:08:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:08:15 devstack sudo[92374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0 1G
Sep 28 18:08:15 devstack sudo[92374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:08:16 devstack sudo[92374]: pam_unix(sudo:session): session closed for user root
Sep 28 18:08:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0 1G" returned: 0 in 0.696s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:08:16 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Downloaded image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}])) to volume a65fa9a0-727a-48fb-9a12-efc0784a0df0 successfully. {{(pid=87046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 28 18:08:16 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Temporary image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 for user ff320b7e01f445cc87f175e8023ef211 is deleted. {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 28 18:08:16 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Marking volume a65fa9a0-727a-48fb-9a12-efc0784a0df0 as bootable. {{(pid=87046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 28 18:08:16 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Copying metadata from image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 to a65fa9a0-727a-48fb-9a12-efc0784a0df0. {{(pid=87046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 28 18:08:16 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Creating volume glance metadata for volume a65fa9a0-727a-48fb-9a12-efc0784a0df0 backed by image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 28 18:08:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62afd291-9080-4a7d-bed6-ba8ec3efc302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0', 'volume_size': 1, 'image_id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de2452cfca174dfbbc7b50b163b23faa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'created_at': datetime.datetime(2026, 9, 28, 15, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 58, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aaedf5550>}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:08:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81190257-3bd7-4311-91d9-ec005ab7d20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:08:16 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Volume volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0 (a65fa9a0-727a-48fb-9a12-efc0784a0df0): created successfully
Sep 28 18:08:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81190257-3bd7-4311-91d9-ec005ab7d20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:08:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Flow 'volume_create_manager' (6aba5298-bead-4cea-86dc-ad2f8749c528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:08:16 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d85a1641-fb1a-4f57-a590-00b740f8e2d5 tempest-ServerActionsTestOtherA-595876003 None] Created volume successfully.
Sep 28 18:08:19 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-ee245151-4038-4865-ac2a-1b5989f6a384 req-55dd6764-fe5c-4dfe-ab58-5a9947ad3722 tempest-AttachVolumeShelveTestJSON-747928854 None] No connector for attachment 3e834aff-8696-491c-903d-83bc0276ad46; skipping storage backend terminate_connection call. {{(pid=87046) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 28 18:08:19 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-ee245151-4038-4865-ac2a-1b5989f6a384 req-55dd6764-fe5c-4dfe-ab58-5a9947ad3722 tempest-AttachVolumeShelveTestJSON-747928854 None] Deleting attachment 3e834aff-8696-491c-903d-83bc0276ad46. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:08:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-230033c5-66d1-47c8-907d-0c84bba06041 req-6866461b-0d17-43d8-82a6-43726ac54571 tempest-ServerActionsTestOtherA-595876003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:08:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-230033c5-66d1-47c8-907d-0c84bba06041 req-6866461b-0d17-43d8-82a6-43726ac54571 tempest-ServerActionsTestOtherA-595876003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:08:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-230033c5-66d1-47c8-907d-0c84bba06041 req-6866461b-0d17-43d8-82a6-43726ac54571 tempest-ServerActionsTestOtherA-595876003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:08:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-230033c5-66d1-47c8-907d-0c84bba06041 req-6866461b-0d17-43d8-82a6-43726ac54571 tempest-ServerActionsTestOtherA-595876003 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1db1af74-9b37-44bd-8710-35a144ee2ec8', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:08:21 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-230033c5-66d1-47c8-907d-0c84bba06041 req-6866461b-0d17-43d8-82a6-43726ac54571 tempest-ServerActionsTestOtherA-595876003 None] attachment_update completed successfully.
Sep 28 18:08:31 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=43,cinder:UPDATE=45,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:08:31 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=39,cinder:UPDATE=39,cinder:INSERT=19,cinder:DELETE=6 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:08:35 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:08:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Flow 'volume_create_manager' (df6425f2-388c-4ac3-9742-13c0c49a893d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:08:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a7116f-2765-4b54-8805-d5fe054593d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:08:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a7116f-2765-4b54-8805-d5fe054593d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-743877327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb2671d-6176-4ac7-8a55-e417cde60033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39d00b8b0e45189d54804408d7954e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:35Z,use_quota=True,user_id='44adb64f526e4236acf3bcdd063170ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:08:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f525e7ac-5482-43a8-b30a-1195cadadabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:08:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f525e7ac-5482-43a8-b30a-1195cadadabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:08:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee2915d-1a2f-44cc-9648-b043d91b5913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:08:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee2915d-1a2f-44cc-9648-b043d91b5913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eb2671d-6176-4ac7-8a55-e417cde60033', 'volume_name': 'volume-3eb2671d-6176-4ac7-8a55-e417cde60033', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:08:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf853562-83fa-46d9-9d7e-852e76eb8b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:08:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf853562-83fa-46d9-9d7e-852e76eb8b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:08:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1260fa1-f0ac-4e56-99f5-6140b3e70a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:08:35 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Volume 3eb2671d-6176-4ac7-8a55-e417cde60033: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eb2671d-6176-4ac7-8a55-e417cde60033', 'volume_size': 1}
Sep 28 18:08:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:08:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:08:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-743877327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb2671d-6176-4ac7-8a55-e417cde60033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39d00b8b0e45189d54804408d7954e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:35Z,use_quota=True,user_id='44adb64f526e4236acf3bcdd063170ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:08:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Creating volume 3eb2671d-6176-4ac7-8a55-e417cde60033 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:08:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:08:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:08:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:08:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:08:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:08:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:08:35 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:08:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3eb2671d-6176-4ac7-8a55-e417cde60033 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:08:35 devstack sudo[93033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3eb2671d-6176-4ac7-8a55-e417cde60033 1073741824
Sep 28 18:08:35 devstack sudo[93033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:08:37 devstack sudo[93033]: pam_unix(sudo:session): session closed for user root
Sep 28 18:08:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3eb2671d-6176-4ac7-8a55-e417cde60033 1073741824" returned: 0 in 1.576s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:08:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3eb2671d-6176-4ac7-8a55-e417cde60033 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:08:37 devstack sudo[93038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3eb2671d-6176-4ac7-8a55-e417cde60033
Sep 28 18:08:37 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:08:37 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root
Sep 28 18:08:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3eb2671d-6176-4ac7-8a55-e417cde60033" returned: 0 in 0.447s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:08:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:08:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.171s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:08:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1260fa1-f0ac-4e56-99f5-6140b3e70a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eb2671d-6176-4ac7-8a55-e417cde60033', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:08:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda3ea9d-4e65-413b-af4d-328259fa5c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:08:37 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Volume volume-3eb2671d-6176-4ac7-8a55-e417cde60033 (3eb2671d-6176-4ac7-8a55-e417cde60033): created successfully
Sep 28 18:08:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda3ea9d-4e65-413b-af4d-328259fa5c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:08:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Flow 'volume_create_manager' (df6425f2-388c-4ac3-9742-13c0c49a893d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:08:37 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-0d8e65af-f998-4ee3-967e-50c84c75738c tempest-AbsoluteLimitsTests-247259318 None] Created volume successfully.
Sep 28 18:08:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:08:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:08:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:08:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:08:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:08:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:08:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:08:39 devstack sudo[93059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:08:39 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:08:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-46f1ab94-50a3-4e54-9240-6fcbcea13651 tempest-AbsoluteLimitsTests-247259318 None] Acquiring lock "cinder-3eb2671d-6176-4ac7-8a55-e417cde60033-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:08:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-46f1ab94-50a3-4e54-9240-6fcbcea13651 tempest-AbsoluteLimitsTests-247259318 None] Lock "cinder-3eb2671d-6176-4ac7-8a55-e417cde60033-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:08:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-46f1ab94-50a3-4e54-9240-6fcbcea13651 tempest-AbsoluteLimitsTests-247259318 None] Acquiring lock "cinder-quobyte-3eb2671d-6176-4ac7-8a55-e417cde60033" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:08:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-46f1ab94-50a3-4e54-9240-6fcbcea13651 tempest-AbsoluteLimitsTests-247259318 None] Lock "cinder-quobyte-3eb2671d-6176-4ac7-8a55-e417cde60033" acquired by "delete_volume" :: waited 0.057s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:08:40 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9236156e-56e1-4dda-bad3-94c1e16b6ea7]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:08:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46f1ab94-50a3-4e54-9240-6fcbcea13651 tempest-AbsoluteLimitsTests-247259318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3eb2671d-6176-4ac7-8a55-e417cde60033 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:08:40 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root
Sep 28 18:08:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 1.304s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:08:40 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:08:40 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:08:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:08:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:08:40 devstack sudo[93087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3eb2671d-6176-4ac7-8a55-e417cde60033
Sep 28 18:08:40 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:08:41 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root
Sep 28 18:08:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46f1ab94-50a3-4e54-9240-6fcbcea13651 tempest-AbsoluteLimitsTests-247259318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3eb2671d-6176-4ac7-8a55-e417cde60033" returned: 0 in 1.476s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:08:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46f1ab94-50a3-4e54-9240-6fcbcea13651 tempest-AbsoluteLimitsTests-247259318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3eb2671d-6176-4ac7-8a55-e417cde60033 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:08:42 devstack sudo[93119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3eb2671d-6176-4ac7-8a55-e417cde60033
Sep 28 18:08:42 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:08:42 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root
Sep 28 18:08:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46f1ab94-50a3-4e54-9240-6fcbcea13651 tempest-AbsoluteLimitsTests-247259318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3eb2671d-6176-4ac7-8a55-e417cde60033" returned: 0 in 0.987s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:08:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-46f1ab94-50a3-4e54-9240-6fcbcea13651 tempest-AbsoluteLimitsTests-247259318 None] Lock "cinder-quobyte-3eb2671d-6176-4ac7-8a55-e417cde60033" released by "delete_volume" :: held 2.647s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:08:43 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-46f1ab94-50a3-4e54-9240-6fcbcea13651 tempest-AbsoluteLimitsTests-247259318 None] Created reservations ['e59e2f40-8104-4204-b1eb-7b56f7e082f7', '41ab3619-2f13-4a79-b019-1a9f8361a9bc', 'b07e67f9-55ae-48f0-a7e7-92308f49dba0', '2af2afb1-bbc2-4034-b6c1-1556ca28248a'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:08:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-46f1ab94-50a3-4e54-9240-6fcbcea13651 tempest-AbsoluteLimitsTests-247259318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:08:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-46f1ab94-50a3-4e54-9240-6fcbcea13651 tempest-AbsoluteLimitsTests-247259318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:08:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-46f1ab94-50a3-4e54-9240-6fcbcea13651 tempest-AbsoluteLimitsTests-247259318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:08:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-46f1ab94-50a3-4e54-9240-6fcbcea13651 tempest-AbsoluteLimitsTests-247259318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:08:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-46f1ab94-50a3-4e54-9240-6fcbcea13651 tempest-AbsoluteLimitsTests-247259318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:08:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46f1ab94-50a3-4e54-9240-6fcbcea13651 tempest-AbsoluteLimitsTests-247259318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:08:43 devstack sudo[93143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:08:43 devstack sudo[93143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:08:44 devstack sudo[93143]: pam_unix(sudo:session): session closed for user root
Sep 28 18:08:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46f1ab94-50a3-4e54-9240-6fcbcea13651 tempest-AbsoluteLimitsTests-247259318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 1.043s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:08:44 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-46f1ab94-50a3-4e54-9240-6fcbcea13651 tempest-AbsoluteLimitsTests-247259318 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:08:44 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-46f1ab94-50a3-4e54-9240-6fcbcea13651 tempest-AbsoluteLimitsTests-247259318 None] Deleted volume successfully.
Sep 28 18:08:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-46f1ab94-50a3-4e54-9240-6fcbcea13651 tempest-AbsoluteLimitsTests-247259318 None] Lock "cinder-3eb2671d-6176-4ac7-8a55-e417cde60033-delete_volume" released by "delete_volume" :: held 4.593s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:08:53 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=7,cinder:UPDATE=12,cinder:INSERT=3 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:08:54 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:UPDATE=10,cinder:SELECT=7,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:08:55 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-023da557-1faf-4845-8c44-420aa935e7e5 req-387d9be9-b254-4a30-bb33-fa7db7f87e50 tempest-ServerActionsTestOtherA-595876003 None] Terminate volume connection completed successfully.
Sep 28 18:08:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-023da557-1faf-4845-8c44-420aa935e7e5 req-387d9be9-b254-4a30-bb33-fa7db7f87e50 tempest-ServerActionsTestOtherA-595876003 None] Deleting attachment 1db1af74-9b37-44bd-8710-35a144ee2ec8. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:08:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-023da557-1faf-4845-8c44-420aa935e7e5 req-8e3eb15d-3fe8-4a2f-823b-ad96b020bff3 tempest-ServerActionsTestOtherA-595876003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:08:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-023da557-1faf-4845-8c44-420aa935e7e5 req-8e3eb15d-3fe8-4a2f-823b-ad96b020bff3 tempest-ServerActionsTestOtherA-595876003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:08:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-023da557-1faf-4845-8c44-420aa935e7e5 req-8e3eb15d-3fe8-4a2f-823b-ad96b020bff3 tempest-ServerActionsTestOtherA-595876003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:08:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-023da557-1faf-4845-8c44-420aa935e7e5 req-8e3eb15d-3fe8-4a2f-823b-ad96b020bff3 tempest-ServerActionsTestOtherA-595876003 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26fd1063-ce5a-4b42-bd97-4c75eaf1d59a', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:08:59 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-023da557-1faf-4845-8c44-420aa935e7e5 req-8e3eb15d-3fe8-4a2f-823b-ad96b020bff3 tempest-ServerActionsTestOtherA-595876003 None] attachment_update completed successfully.
Sep 28 18:09:00 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:09:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Flow 'volume_create_manager' (6d339411-96d5-4b31-9c15-44a287eebb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:09:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c5914d-7c17-4cce-b2ec-adc342aba00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c5914d-7c17-4cce-b2ec-adc342aba00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-571454211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601643b7-fc67-4358-beef-11d32f60b556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4359b63a15584ee9940fd00f075cba98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:00Z,use_quota=True,user_id='ec82920a5d414f55b7d979eda9b2fa22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ddf1f6-9652-429a-84e0-00ecf4b9c7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ddf1f6-9652-429a-84e0-00ecf4b9c7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c34cdb67-71f0-48b3-b308-11995a1b19fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c34cdb67-71f0-48b3-b308-11995a1b19fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '601643b7-fc67-4358-beef-11d32f60b556', 'volume_name': 'volume-601643b7-fc67-4358-beef-11d32f60b556', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70017094-21a6-4696-92cc-f4179d218b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70017094-21a6-4696-92cc-f4179d218b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c037b228-7969-4f99-b3a7-d77a33ac0598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:00 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Volume 601643b7-fc67-4358-beef-11d32f60b556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-601643b7-fc67-4358-beef-11d32f60b556', 'volume_size': 1}
Sep 28 18:09:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-571454211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601643b7-fc67-4358-beef-11d32f60b556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4359b63a15584ee9940fd00f075cba98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:00Z,use_quota=True,user_id='ec82920a5d414f55b7d979eda9b2fa22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:09:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Creating volume 601643b7-fc67-4358-beef-11d32f60b556 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:09:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:09:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:09:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:09:00 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:09:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-601643b7-fc67-4358-beef-11d32f60b556 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:00 devstack sudo[93417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-601643b7-fc67-4358-beef-11d32f60b556 1073741824
Sep 28 18:09:00 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:01 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-601643b7-fc67-4358-beef-11d32f60b556 1073741824" returned: 0 in 0.903s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-601643b7-fc67-4358-beef-11d32f60b556 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:01 devstack sudo[93738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-601643b7-fc67-4358-beef-11d32f60b556
Sep 28 18:09:01 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:01 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-601643b7-fc67-4358-beef-11d32f60b556" returned: 0 in 0.344s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:09:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c037b228-7969-4f99-b3a7-d77a33ac0598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-601643b7-fc67-4358-beef-11d32f60b556', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a95c044-b133-492c-9b36-cd525933d464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:01 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Volume volume-601643b7-fc67-4358-beef-11d32f60b556 (601643b7-fc67-4358-beef-11d32f60b556): created successfully
Sep 28 18:09:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a95c044-b133-492c-9b36-cd525933d464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Flow 'volume_create_manager' (6d339411-96d5-4b31-9c15-44a287eebb02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:09:02 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-7facb566-d081-4b49-96b7-945451192561 tempest-VolumesTransfersTest-1211588167 None] Created volume successfully.
Sep 28 18:09:03 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-e585f026-fe26-4d8a-bdfc-1481125195ae tempest-VolumesTransfersTest-899432138 None] Transfer volume completed successfully.
Sep 28 18:09:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1b8d666d-6de5-4727-b30c-86fe17915d96 tempest-VolumesTransfersTest-696840502 None] Acquiring lock "cinder-601643b7-fc67-4358-beef-11d32f60b556-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:09:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1b8d666d-6de5-4727-b30c-86fe17915d96 tempest-VolumesTransfersTest-696840502 None] Lock "cinder-601643b7-fc67-4358-beef-11d32f60b556-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:09:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1b8d666d-6de5-4727-b30c-86fe17915d96 tempest-VolumesTransfersTest-696840502 None] Acquiring lock "cinder-quobyte-601643b7-fc67-4358-beef-11d32f60b556" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:09:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1b8d666d-6de5-4727-b30c-86fe17915d96 tempest-VolumesTransfersTest-696840502 None] Lock "cinder-quobyte-601643b7-fc67-4358-beef-11d32f60b556" acquired by "delete_volume" :: waited 0.040s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:09:05 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[606b11b4-3e46-41cf-a355-8dfe6263d841]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:09:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b8d666d-6de5-4727-b30c-86fe17915d96 tempest-VolumesTransfersTest-696840502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-601643b7-fc67-4358-beef-11d32f60b556 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:05 devstack sudo[93772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-601643b7-fc67-4358-beef-11d32f60b556
Sep 28 18:09:05 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:06 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b8d666d-6de5-4727-b30c-86fe17915d96 tempest-VolumesTransfersTest-696840502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-601643b7-fc67-4358-beef-11d32f60b556" returned: 0 in 0.751s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b8d666d-6de5-4727-b30c-86fe17915d96 tempest-VolumesTransfersTest-696840502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-601643b7-fc67-4358-beef-11d32f60b556 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:06 devstack sudo[93777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-601643b7-fc67-4358-beef-11d32f60b556
Sep 28 18:09:06 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:06 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b8d666d-6de5-4727-b30c-86fe17915d96 tempest-VolumesTransfersTest-696840502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-601643b7-fc67-4358-beef-11d32f60b556" returned: 0 in 0.436s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:06 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1b8d666d-6de5-4727-b30c-86fe17915d96 tempest-VolumesTransfersTest-696840502 None] Lock "cinder-quobyte-601643b7-fc67-4358-beef-11d32f60b556" released by "delete_volume" :: held 1.310s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:09:06 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-1b8d666d-6de5-4727-b30c-86fe17915d96 tempest-VolumesTransfersTest-696840502 None] Created reservations ['3c62291c-f496-4eab-a8e2-506f4db976a2', '371c560e-8aeb-47cd-a5dc-2f1e7cd04846', 'c76769c8-85e6-4d73-90fd-600a60da1234', '1a382f64-b36a-48b7-a662-055bbb9da042'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:09:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1b8d666d-6de5-4727-b30c-86fe17915d96 tempest-VolumesTransfersTest-696840502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1b8d666d-6de5-4727-b30c-86fe17915d96 tempest-VolumesTransfersTest-696840502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:06 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1b8d666d-6de5-4727-b30c-86fe17915d96 tempest-VolumesTransfersTest-696840502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:09:06 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1b8d666d-6de5-4727-b30c-86fe17915d96 tempest-VolumesTransfersTest-696840502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:09:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1b8d666d-6de5-4727-b30c-86fe17915d96 tempest-VolumesTransfersTest-696840502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b8d666d-6de5-4727-b30c-86fe17915d96 tempest-VolumesTransfersTest-696840502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:06 devstack sudo[93780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:09:06 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:07 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b8d666d-6de5-4727-b30c-86fe17915d96 tempest-VolumesTransfersTest-696840502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.464s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:07 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-1b8d666d-6de5-4727-b30c-86fe17915d96 tempest-VolumesTransfersTest-696840502 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:09:07 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-1b8d666d-6de5-4727-b30c-86fe17915d96 tempest-VolumesTransfersTest-696840502 None] Deleted volume successfully.
Sep 28 18:09:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1b8d666d-6de5-4727-b30c-86fe17915d96 tempest-VolumesTransfersTest-696840502 None] Lock "cinder-601643b7-fc67-4358-beef-11d32f60b556-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:09:08 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:09:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Flow 'volume_create_manager' (7681d854-758d-4862-895d-32e304be275f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:09:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0c24df-4ff2-4b4a-affb-f09751a25640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0c24df-4ff2-4b4a-affb-f09751a25640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2019195862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d93d62b1-3796-4a78-9169-43453a45c9dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4359b63a15584ee9940fd00f075cba98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:08Z,use_quota=True,user_id='ec82920a5d414f55b7d979eda9b2fa22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf1d0ce-d964-41ae-a3c1-3241a421082e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf1d0ce-d964-41ae-a3c1-3241a421082e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8604e34-cef2-4b33-be35-e8435cad762e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8604e34-cef2-4b33-be35-e8435cad762e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd93d62b1-3796-4a78-9169-43453a45c9dd', 'volume_name': 'volume-d93d62b1-3796-4a78-9169-43453a45c9dd', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7862f320-4dfc-4223-8129-eaab0f29597d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7862f320-4dfc-4223-8129-eaab0f29597d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce6cb72-0592-4cd0-97a6-1a354f2e99cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:08 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Volume d93d62b1-3796-4a78-9169-43453a45c9dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d93d62b1-3796-4a78-9169-43453a45c9dd', 'volume_size': 1}
Sep 28 18:09:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2019195862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d93d62b1-3796-4a78-9169-43453a45c9dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4359b63a15584ee9940fd00f075cba98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:08Z,use_quota=True,user_id='ec82920a5d414f55b7d979eda9b2fa22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:09:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Creating volume d93d62b1-3796-4a78-9169-43453a45c9dd {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:09:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:09:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:09:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:09:08 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:09:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d93d62b1-3796-4a78-9169-43453a45c9dd 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:08 devstack sudo[93783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d93d62b1-3796-4a78-9169-43453a45c9dd 1073741824
Sep 28 18:09:08 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:09 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d93d62b1-3796-4a78-9169-43453a45c9dd 1073741824" returned: 0 in 0.596s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d93d62b1-3796-4a78-9169-43453a45c9dd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:09 devstack sudo[93790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d93d62b1-3796-4a78-9169-43453a45c9dd
Sep 28 18:09:09 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:09 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d93d62b1-3796-4a78-9169-43453a45c9dd" returned: 0 in 0.324s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:09:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:09 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce6cb72-0592-4cd0-97a6-1a354f2e99cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d93d62b1-3796-4a78-9169-43453a45c9dd', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:09 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6679f17f-e30b-4dbf-8e4a-cc0c3e263602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:09 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Volume volume-d93d62b1-3796-4a78-9169-43453a45c9dd (d93d62b1-3796-4a78-9169-43453a45c9dd): created successfully
Sep 28 18:09:09 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6679f17f-e30b-4dbf-8e4a-cc0c3e263602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:09 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Flow 'volume_create_manager' (7681d854-758d-4862-895d-32e304be275f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:09:09 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-892cc557-fcb1-4079-803a-24ffae4ee7c1 tempest-VolumesTransfersTest-1211588167 None] Created volume successfully.
Sep 28 18:09:10 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a65b1200-4f3d-48b7-b7de-ea651480fe8f tempest-VolumesTransfersTest-696840502 None] Acquiring lock "cinder-d93d62b1-3796-4a78-9169-43453a45c9dd-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:09:10 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a65b1200-4f3d-48b7-b7de-ea651480fe8f tempest-VolumesTransfersTest-696840502 None] Lock "cinder-d93d62b1-3796-4a78-9169-43453a45c9dd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:09:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a65b1200-4f3d-48b7-b7de-ea651480fe8f tempest-VolumesTransfersTest-696840502 None] Acquiring lock "cinder-quobyte-d93d62b1-3796-4a78-9169-43453a45c9dd" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:09:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a65b1200-4f3d-48b7-b7de-ea651480fe8f tempest-VolumesTransfersTest-696840502 None] Lock "cinder-quobyte-d93d62b1-3796-4a78-9169-43453a45c9dd" acquired by "delete_volume" :: waited 0.030s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:09:11 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2259bd-cb92-4ccc-b3d8-77ec8de06842]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:09:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a65b1200-4f3d-48b7-b7de-ea651480fe8f tempest-VolumesTransfersTest-696840502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d93d62b1-3796-4a78-9169-43453a45c9dd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:11 devstack sudo[93793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d93d62b1-3796-4a78-9169-43453a45c9dd
Sep 28 18:09:11 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:11 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a65b1200-4f3d-48b7-b7de-ea651480fe8f tempest-VolumesTransfersTest-696840502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d93d62b1-3796-4a78-9169-43453a45c9dd" returned: 0 in 0.553s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a65b1200-4f3d-48b7-b7de-ea651480fe8f tempest-VolumesTransfersTest-696840502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d93d62b1-3796-4a78-9169-43453a45c9dd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:11 devstack sudo[93798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d93d62b1-3796-4a78-9169-43453a45c9dd
Sep 28 18:09:11 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:11 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a65b1200-4f3d-48b7-b7de-ea651480fe8f tempest-VolumesTransfersTest-696840502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d93d62b1-3796-4a78-9169-43453a45c9dd" returned: 0 in 0.360s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:12 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a65b1200-4f3d-48b7-b7de-ea651480fe8f tempest-VolumesTransfersTest-696840502 None] Lock "cinder-quobyte-d93d62b1-3796-4a78-9169-43453a45c9dd" released by "delete_volume" :: held 0.978s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:09:12 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-a65b1200-4f3d-48b7-b7de-ea651480fe8f tempest-VolumesTransfersTest-696840502 None] Created reservations ['d745c454-e81c-4606-a9cc-557fb477df99', '165a1a67-9604-4f7e-bda4-b9ca2e6684ca', 'ab6077d8-155c-4a93-9456-3c379802c614', '58daf9ef-0977-4903-8fc2-bd45fdcd44ae'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:09:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a65b1200-4f3d-48b7-b7de-ea651480fe8f tempest-VolumesTransfersTest-696840502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a65b1200-4f3d-48b7-b7de-ea651480fe8f tempest-VolumesTransfersTest-696840502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a65b1200-4f3d-48b7-b7de-ea651480fe8f tempest-VolumesTransfersTest-696840502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:09:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a65b1200-4f3d-48b7-b7de-ea651480fe8f tempest-VolumesTransfersTest-696840502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:09:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a65b1200-4f3d-48b7-b7de-ea651480fe8f tempest-VolumesTransfersTest-696840502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a65b1200-4f3d-48b7-b7de-ea651480fe8f tempest-VolumesTransfersTest-696840502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:12 devstack sudo[93802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:09:12 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:12 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a65b1200-4f3d-48b7-b7de-ea651480fe8f tempest-VolumesTransfersTest-696840502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.312s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:12 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-a65b1200-4f3d-48b7-b7de-ea651480fe8f tempest-VolumesTransfersTest-696840502 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:09:12 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-a65b1200-4f3d-48b7-b7de-ea651480fe8f tempest-VolumesTransfersTest-696840502 None] Deleted volume successfully.
Sep 28 18:09:12 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a65b1200-4f3d-48b7-b7de-ea651480fe8f tempest-VolumesTransfersTest-696840502 None] Lock "cinder-d93d62b1-3796-4a78-9169-43453a45c9dd-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Flow 'volume_create_manager' (6e243558-861a-4953-94ea-5c5c82cf21aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25aa9620-acd5-48db-8467-d9858f0093c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25aa9620-acd5-48db-8467-d9858f0093c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1602054774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3187d71-42d1-4c53-984f-bb5aa6d33da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05195898e62a4a92ae9ba40425182674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:18Z,use_quota=True,user_id='e2eca852aa934d6ab40133dfda0eeca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3d5c0d-acd3-4541-bb31-009c14f5661a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3d5c0d-acd3-4541-bb31-009c14f5661a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ebfbcd0-bd0c-4a83-9509-776f692896f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ebfbcd0-bd0c-4a83-9509-776f692896f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3187d71-42d1-4c53-984f-bb5aa6d33da9', 'volume_name': 'volume-a3187d71-42d1-4c53-984f-bb5aa6d33da9', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d404aa-074e-48b9-8255-1071577afda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d404aa-074e-48b9-8255-1071577afda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30438081-9e15-4021-96d1-3cd22cdf1bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:18 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Volume a3187d71-42d1-4c53-984f-bb5aa6d33da9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3187d71-42d1-4c53-984f-bb5aa6d33da9', 'volume_size': 1}
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1602054774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3187d71-42d1-4c53-984f-bb5aa6d33da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05195898e62a4a92ae9ba40425182674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:18Z,use_quota=True,user_id='e2eca852aa934d6ab40133dfda0eeca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Creating volume a3187d71-42d1-4c53-984f-bb5aa6d33da9 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:09:18 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a3187d71-42d1-4c53-984f-bb5aa6d33da9 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:18 devstack sudo[93848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a3187d71-42d1-4c53-984f-bb5aa6d33da9 1073741824
Sep 28 18:09:18 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:18 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a3187d71-42d1-4c53-984f-bb5aa6d33da9 1073741824" returned: 0 in 0.702s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a3187d71-42d1-4c53-984f-bb5aa6d33da9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:19 devstack sudo[93855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a3187d71-42d1-4c53-984f-bb5aa6d33da9
Sep 28 18:09:19 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:19 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a3187d71-42d1-4c53-984f-bb5aa6d33da9" returned: 0 in 0.442s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:19 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:09:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:19 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30438081-9e15-4021-96d1-3cd22cdf1bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3187d71-42d1-4c53-984f-bb5aa6d33da9', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:19 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3507c414-c723-44b1-aa0e-65121e16c072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:19 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Volume volume-a3187d71-42d1-4c53-984f-bb5aa6d33da9 (a3187d71-42d1-4c53-984f-bb5aa6d33da9): created successfully
Sep 28 18:09:19 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3507c414-c723-44b1-aa0e-65121e16c072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:19 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Flow 'volume_create_manager' (6e243558-861a-4953-94ea-5c5c82cf21aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:09:19 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-50d7c389-22b9-41c8-b338-d5bab6f9d17d tempest-AttachVolumeTestJSON-721645988 None] Created volume successfully.
Sep 28 18:09:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-ac4ee184-c14f-417e-a012-23f289798227 req-6a3b055c-a99a-40e3-badf-ac68e38e9af2 tempest-AttachVolumeTestJSON-721645988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-ac4ee184-c14f-417e-a012-23f289798227 req-6a3b055c-a99a-40e3-badf-ac68e38e9af2 tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-ac4ee184-c14f-417e-a012-23f289798227 req-6a3b055c-a99a-40e3-badf-ac68e38e9af2 tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-ac4ee184-c14f-417e-a012-23f289798227 req-6a3b055c-a99a-40e3-badf-ac68e38e9af2 tempest-AttachVolumeTestJSON-721645988 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-a3187d71-42d1-4c53-984f-bb5aa6d33da9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d6e8148-2c78-4674-b64d-646c997073ce', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:09:21 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-ac4ee184-c14f-417e-a012-23f289798227 req-6a3b055c-a99a-40e3-badf-ac68e38e9af2 tempest-AttachVolumeTestJSON-721645988 None] attachment_update completed successfully.
Sep 28 18:09:31 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2d0fcb71-f670-480e-b056-9c21245fe339 tempest-AttachVolumeShelveTestJSON-747928854 None] Acquiring lock "cinder-d09bb376-e5c0-439e-a819-a879e43020a7-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:09:31 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2d0fcb71-f670-480e-b056-9c21245fe339 tempest-AttachVolumeShelveTestJSON-747928854 None] Lock "cinder-d09bb376-e5c0-439e-a819-a879e43020a7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:09:31 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2d0fcb71-f670-480e-b056-9c21245fe339 tempest-AttachVolumeShelveTestJSON-747928854 None] Acquiring lock "cinder-quobyte-d09bb376-e5c0-439e-a819-a879e43020a7" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:09:31 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2d0fcb71-f670-480e-b056-9c21245fe339 tempest-AttachVolumeShelveTestJSON-747928854 None] Lock "cinder-quobyte-d09bb376-e5c0-439e-a819-a879e43020a7" acquired by "delete_volume" :: waited 0.018s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:09:31 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe6cbd2-8b1d-4ab4-b58c-ed7a6e193f5e]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:09:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2d0fcb71-f670-480e-b056-9c21245fe339 tempest-AttachVolumeShelveTestJSON-747928854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d09bb376-e5c0-439e-a819-a879e43020a7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:31 devstack sudo[94042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d09bb376-e5c0-439e-a819-a879e43020a7
Sep 28 18:09:31 devstack sudo[94042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:32 devstack sudo[94042]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2d0fcb71-f670-480e-b056-9c21245fe339 tempest-AttachVolumeShelveTestJSON-747928854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d09bb376-e5c0-439e-a819-a879e43020a7" returned: 0 in 0.582s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2d0fcb71-f670-480e-b056-9c21245fe339 tempest-AttachVolumeShelveTestJSON-747928854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d09bb376-e5c0-439e-a819-a879e43020a7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:32 devstack sudo[94063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d09bb376-e5c0-439e-a819-a879e43020a7
Sep 28 18:09:32 devstack sudo[94063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:32 devstack sudo[94063]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2d0fcb71-f670-480e-b056-9c21245fe339 tempest-AttachVolumeShelveTestJSON-747928854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d09bb376-e5c0-439e-a819-a879e43020a7" returned: 0 in 0.372s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:32 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2d0fcb71-f670-480e-b056-9c21245fe339 tempest-AttachVolumeShelveTestJSON-747928854 None] Lock "cinder-quobyte-d09bb376-e5c0-439e-a819-a879e43020a7" released by "delete_volume" :: held 1.044s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:09:32 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-2d0fcb71-f670-480e-b056-9c21245fe339 tempest-AttachVolumeShelveTestJSON-747928854 None] Created reservations ['41d16e1c-3aa2-45dd-b05a-0b19613030dc', 'b797e448-15f1-4b4a-bb5d-680c7d033861', '1f66a3e6-1fea-41b6-9876-b929883bf011', '16492b75-2211-4fa7-8fc3-7f75cb63a18c'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:09:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2d0fcb71-f670-480e-b056-9c21245fe339 tempest-AttachVolumeShelveTestJSON-747928854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2d0fcb71-f670-480e-b056-9c21245fe339 tempest-AttachVolumeShelveTestJSON-747928854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2d0fcb71-f670-480e-b056-9c21245fe339 tempest-AttachVolumeShelveTestJSON-747928854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:09:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2d0fcb71-f670-480e-b056-9c21245fe339 tempest-AttachVolumeShelveTestJSON-747928854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:09:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2d0fcb71-f670-480e-b056-9c21245fe339 tempest-AttachVolumeShelveTestJSON-747928854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2d0fcb71-f670-480e-b056-9c21245fe339 tempest-AttachVolumeShelveTestJSON-747928854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:32 devstack sudo[94077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:09:32 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:33 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2d0fcb71-f670-480e-b056-9c21245fe339 tempest-AttachVolumeShelveTestJSON-747928854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.352s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:33 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-2d0fcb71-f670-480e-b056-9c21245fe339 tempest-AttachVolumeShelveTestJSON-747928854 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:09:33 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-2d0fcb71-f670-480e-b056-9c21245fe339 tempest-AttachVolumeShelveTestJSON-747928854 None] Deleted volume successfully.
Sep 28 18:09:33 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2d0fcb71-f670-480e-b056-9c21245fe339 tempest-AttachVolumeShelveTestJSON-747928854 None] Lock "cinder-d09bb376-e5c0-439e-a819-a879e43020a7-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:09:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:09:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:09:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:09:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:39 devstack sudo[94084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:09:39 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:39 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.555s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:09:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:09:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:09:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:09:42 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=34,cinder:UPDATE=36,cinder:INSERT=10,cinder:DELETE=1 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:09:43 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=38,cinder:UPDATE=37,cinder:DELETE=5,cinder:INSERT=5 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:09:48 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:09:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Flow 'volume_create_manager' (0ed84f0b-6f0b-478a-8181-c7c0727470a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:09:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835f30ea-e98c-4923-8adb-1682bb01120f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835f30ea-e98c-4923-8adb-1682bb01120f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-639436354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=077bf7d1-1c33-4dce-b5da-9b6737e7b80f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d09f189f2d664f87b62783366f9738f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:48Z,use_quota=True,user_id='a8793fa942d541d4b04b693c927ffddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb288cf-b8da-4ff2-a875-b32d9e9f6dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb288cf-b8da-4ff2-a875-b32d9e9f6dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a5d8d50-5523-43c4-b526-03e0a9251494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a5d8d50-5523-43c4-b526-03e0a9251494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '077bf7d1-1c33-4dce-b5da-9b6737e7b80f', 'volume_name': 'volume-077bf7d1-1c33-4dce-b5da-9b6737e7b80f', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3fe86f-1a41-4308-a157-7ce2cecaf875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3fe86f-1a41-4308-a157-7ce2cecaf875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e129fe-7fd6-49fe-8fca-8dc87d35ad91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:48 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Volume 077bf7d1-1c33-4dce-b5da-9b6737e7b80f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-077bf7d1-1c33-4dce-b5da-9b6737e7b80f', 'volume_size': 1}
Sep 28 18:09:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:48 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-639436354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=077bf7d1-1c33-4dce-b5da-9b6737e7b80f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d09f189f2d664f87b62783366f9738f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:48Z,use_quota=True,user_id='a8793fa942d541d4b04b693c927ffddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:09:48 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Creating volume 077bf7d1-1c33-4dce-b5da-9b6737e7b80f {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:09:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:48 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:09:48 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:09:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:48 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:09:48 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:09:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-077bf7d1-1c33-4dce-b5da-9b6737e7b80f 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:48 devstack sudo[94131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-077bf7d1-1c33-4dce-b5da-9b6737e7b80f 1073741824
Sep 28 18:09:48 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:49 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-077bf7d1-1c33-4dce-b5da-9b6737e7b80f 1073741824" returned: 0 in 0.887s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-077bf7d1-1c33-4dce-b5da-9b6737e7b80f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:49 devstack sudo[94138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-077bf7d1-1c33-4dce-b5da-9b6737e7b80f
Sep 28 18:09:49 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Flow 'volume_create_manager' (5ce917e5-8e45-42c9-876b-29c2e7ee777a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a5585e-3f4b-4346-b7c3-e31affd18556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:49 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-077bf7d1-1c33-4dce-b5da-9b6737e7b80f" returned: 0 in 0.400s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a5585e-3f4b-4346-b7c3-e31affd18556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1363787086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd51056e-9229-486a-9aee-97a63aaf4aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb286279ad05458b8a6745411d252e69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:50Z,use_quota=True,user_id='2116c58e4be6429ea7b907aa247d3b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21690c5e-6ddf-4fc6-9b65-da90112b34c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21690c5e-6ddf-4fc6-9b65-da90112b34c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba094f85-aa84-4545-90e4-22c3c94d7418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba094f85-aa84-4545-90e4-22c3c94d7418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd51056e-9229-486a-9aee-97a63aaf4aa5', 'volume_name': 'volume-dd51056e-9229-486a-9aee-97a63aaf4aa5', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c93b4528-b3a6-47d2-9eb0-756115fa426d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c93b4528-b3a6-47d2-9eb0-756115fa426d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77327eb3-25af-4eb6-abf7-eb686198f42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:49 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Volume dd51056e-9229-486a-9aee-97a63aaf4aa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd51056e-9229-486a-9aee-97a63aaf4aa5', 'volume_size': 1}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1363787086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd51056e-9229-486a-9aee-97a63aaf4aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb286279ad05458b8a6745411d252e69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:50Z,use_quota=True,user_id='2116c58e4be6429ea7b907aa247d3b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Creating volume dd51056e-9229-486a-9aee-97a63aaf4aa5 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:09:49 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e129fe-7fd6-49fe-8fca-8dc87d35ad91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-077bf7d1-1c33-4dce-b5da-9b6737e7b80f', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e32f240-bb3c-4f9f-b3ee-6fcf9cb9412d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:49 devstack sudo[94143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5 1073741824
Sep 28 18:09:49 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:49 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Volume volume-077bf7d1-1c33-4dce-b5da-9b6737e7b80f (077bf7d1-1c33-4dce-b5da-9b6737e7b80f): created successfully
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e32f240-bb3c-4f9f-b3ee-6fcf9cb9412d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Flow 'volume_create_manager' (0ed84f0b-6f0b-478a-8181-c7c0727470a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:09:49 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-ad571515-7b46-4605-ad2f-50a6af897113 tempest-VolumesTestJSON-2129929835 None] Created volume successfully.
Sep 28 18:09:50 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5 1073741824" returned: 0 in 0.587s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:50 devstack sudo[94149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5
Sep 28 18:09:50 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:50 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-3cb711ee-3c15-497e-a04f-c48b3098276f req-f329fbad-2dd5-455e-b11f-49d8466d79db tempest-ServerActionsTestOtherA-595876003 None] Terminate volume connection completed successfully.
Sep 28 18:09:50 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-3cb711ee-3c15-497e-a04f-c48b3098276f req-f329fbad-2dd5-455e-b11f-49d8466d79db tempest-ServerActionsTestOtherA-595876003 None] Deleting attachment 26fd1063-ce5a-4b42-bd97-4c75eaf1d59a. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:09:50 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5" returned: 0 in 0.435s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:09:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:50 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77327eb3-25af-4eb6-abf7-eb686198f42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd51056e-9229-486a-9aee-97a63aaf4aa5', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:50 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c264741b-bd4e-46b3-ade0-87eeab057f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:50 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Volume volume-dd51056e-9229-486a-9aee-97a63aaf4aa5 (dd51056e-9229-486a-9aee-97a63aaf4aa5): created successfully
Sep 28 18:09:50 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c264741b-bd4e-46b3-ade0-87eeab057f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:50 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Flow 'volume_create_manager' (5ce917e5-8e45-42c9-876b-29c2e7ee777a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:09:50 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-6fdb03be-7209-495d-beeb-005e9a899a3b tempest-VolumesSnapshotTestJSON-1795745985 None] Created volume successfully.
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-3cb711ee-3c15-497e-a04f-c48b3098276f req-6f6c54a2-91c8-4c7c-ae0a-2a33ef401156 tempest-ServerActionsTestOtherA-595876003 None] Acquiring lock "cinder-a65fa9a0-727a-48fb-9a12-efc0784a0df0-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-3cb711ee-3c15-497e-a04f-c48b3098276f req-6f6c54a2-91c8-4c7c-ae0a-2a33ef401156 tempest-ServerActionsTestOtherA-595876003 None] Lock "cinder-a65fa9a0-727a-48fb-9a12-efc0784a0df0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Flow 'volume_create_manager' (df27e042-438c-4be9-81b9-d691850efb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c171ac-9529-4ae4-a9f7-aa1716a0ef1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c171ac-9529-4ae4-a9f7-aa1716a0ef1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-897980773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=539ee38b-4f1a-4a31-813c-fae0e65ad703,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d09f189f2d664f87b62783366f9738f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:51Z,use_quota=True,user_id='a8793fa942d541d4b04b693c927ffddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9ec640-904a-4423-9cee-80237bbfd577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9ec640-904a-4423-9cee-80237bbfd577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1f51fe-0616-437e-9928-6aa7c20693ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1f51fe-0616-437e-9928-6aa7c20693ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '539ee38b-4f1a-4a31-813c-fae0e65ad703', 'volume_name': 'volume-539ee38b-4f1a-4a31-813c-fae0e65ad703', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd59fad6-06c7-4fcf-b793-49f75dbaba5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd59fad6-06c7-4fcf-b793-49f75dbaba5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d695b2ba-23d1-4417-94e8-a79b44f20a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:51 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Volume 539ee38b-4f1a-4a31-813c-fae0e65ad703: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-539ee38b-4f1a-4a31-813c-fae0e65ad703', 'volume_size': 1}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-897980773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=539ee38b-4f1a-4a31-813c-fae0e65ad703,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d09f189f2d664f87b62783366f9738f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:51Z,use_quota=True,user_id='a8793fa942d541d4b04b693c927ffddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Creating volume 539ee38b-4f1a-4a31-813c-fae0e65ad703 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:09:51 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-539ee38b-4f1a-4a31-813c-fae0e65ad703 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-3cb711ee-3c15-497e-a04f-c48b3098276f req-6f6c54a2-91c8-4c7c-ae0a-2a33ef401156 tempest-ServerActionsTestOtherA-595876003 None] Acquiring lock "cinder-quobyte-a65fa9a0-727a-48fb-9a12-efc0784a0df0" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:09:51 devstack sudo[94153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-539ee38b-4f1a-4a31-813c-fae0e65ad703 1073741824
Sep 28 18:09:51 devstack sudo[94153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-3cb711ee-3c15-497e-a04f-c48b3098276f req-6f6c54a2-91c8-4c7c-ae0a-2a33ef401156 tempest-ServerActionsTestOtherA-595876003 None] Lock "cinder-quobyte-a65fa9a0-727a-48fb-9a12-efc0784a0df0" acquired by "delete_volume" :: waited 0.024s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a90aa3-0b4a-4661-a7a4-dcae17d4620c]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-3cb711ee-3c15-497e-a04f-c48b3098276f req-6f6c54a2-91c8-4c7c-ae0a-2a33ef401156 tempest-ServerActionsTestOtherA-595876003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:51 devstack sudo[94155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0
Sep 28 18:09:51 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:51 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-3cb711ee-3c15-497e-a04f-c48b3098276f req-6f6c54a2-91c8-4c7c-ae0a-2a33ef401156 tempest-ServerActionsTestOtherA-595876003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0" returned: 0 in 0.436s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-3cb711ee-3c15-497e-a04f-c48b3098276f req-6f6c54a2-91c8-4c7c-ae0a-2a33ef401156 tempest-ServerActionsTestOtherA-595876003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:51 devstack sudo[94153]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-539ee38b-4f1a-4a31-813c-fae0e65ad703 1073741824" returned: 0 in 0.550s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:51 devstack sudo[94164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0
Sep 28 18:09:51 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-539ee38b-4f1a-4a31-813c-fae0e65ad703 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:51 devstack sudo[94166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-539ee38b-4f1a-4a31-813c-fae0e65ad703
Sep 28 18:09:51 devstack sudo[94166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:52 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-3cb711ee-3c15-497e-a04f-c48b3098276f req-6f6c54a2-91c8-4c7c-ae0a-2a33ef401156 tempest-ServerActionsTestOtherA-595876003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a65fa9a0-727a-48fb-9a12-efc0784a0df0" returned: 0 in 0.354s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-3cb711ee-3c15-497e-a04f-c48b3098276f req-6f6c54a2-91c8-4c7c-ae0a-2a33ef401156 tempest-ServerActionsTestOtherA-595876003 None] Lock "cinder-quobyte-a65fa9a0-727a-48fb-9a12-efc0784a0df0" released by "delete_volume" :: held 0.860s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:09:52 devstack sudo[94166]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-539ee38b-4f1a-4a31-813c-fae0e65ad703" returned: 0 in 0.359s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d695b2ba-23d1-4417-94e8-a79b44f20a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-539ee38b-4f1a-4a31-813c-fae0e65ad703', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c922081a-f586-4c71-8629-4d1be5e3123b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:52 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Volume volume-539ee38b-4f1a-4a31-813c-fae0e65ad703 (539ee38b-4f1a-4a31-813c-fae0e65ad703): created successfully
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c922081a-f586-4c71-8629-4d1be5e3123b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Flow 'volume_create_manager' (df27e042-438c-4be9-81b9-d691850efb82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG cinder.quota [req-3cb711ee-3c15-497e-a04f-c48b3098276f req-6f6c54a2-91c8-4c7c-ae0a-2a33ef401156 tempest-ServerActionsTestOtherA-595876003 None] Created reservations ['dcb3e1ba-4c81-49b7-94b0-1f890fbe58d9', '44acde02-2700-4579-ad26-0799a691741d', 'f641f002-3471-4172-80ed-dfc4014ed7a6', '31337fcb-1544-47b3-bcff-ac0dc453eeee'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:09:52 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-da46406d-b32b-4ece-a462-e4d2d8f6c119 tempest-VolumesTestJSON-2129929835 None] Created volume successfully.
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-01c9e82c-50c1-4c93-a264-25753b6bc0be tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-01c9e82c-50c1-4c93-a264-25753b6bc0be tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-01c9e82c-50c1-4c93-a264-25753b6bc0be tempest-VolumesSnapshotTestJSON-1795745985 None] Creating offline snapshot 225fc47f-3fdc-49ab-af92-d163723efbcf of volume dd51056e-9229-486a-9aee-97a63aaf4aa5 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d23405c-69b3-4d3d-98b4-4654a9c6897c]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01c9e82c-50c1-4c93-a264-25753b6bc0be tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-3cb711ee-3c15-497e-a04f-c48b3098276f req-6f6c54a2-91c8-4c7c-ae0a-2a33ef401156 tempest-ServerActionsTestOtherA-595876003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-3cb711ee-3c15-497e-a04f-c48b3098276f req-6f6c54a2-91c8-4c7c-ae0a-2a33ef401156 tempest-ServerActionsTestOtherA-595876003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [req-3cb711ee-3c15-497e-a04f-c48b3098276f req-6f6c54a2-91c8-4c7c-ae0a-2a33ef401156 tempest-ServerActionsTestOtherA-595876003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [req-3cb711ee-3c15-497e-a04f-c48b3098276f req-6f6c54a2-91c8-4c7c-ae0a-2a33ef401156 tempest-ServerActionsTestOtherA-595876003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-3cb711ee-3c15-497e-a04f-c48b3098276f req-6f6c54a2-91c8-4c7c-ae0a-2a33ef401156 tempest-ServerActionsTestOtherA-595876003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-3cb711ee-3c15-497e-a04f-c48b3098276f req-6f6c54a2-91c8-4c7c-ae0a-2a33ef401156 tempest-ServerActionsTestOtherA-595876003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d64e1789-52dc-47be-9bae-39d41b31159c tempest-ServerActionsTestOtherA-595876003 None] Acquiring lock "cinder-a35b8afa-22e2-4558-99d6-cc212fa9b2f7-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:09:52 devstack sudo[94173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:09:52 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d64e1789-52dc-47be-9bae-39d41b31159c tempest-ServerActionsTestOtherA-595876003 None] Lock "cinder-a35b8afa-22e2-4558-99d6-cc212fa9b2f7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d64e1789-52dc-47be-9bae-39d41b31159c tempest-ServerActionsTestOtherA-595876003 None] Acquiring lock "cinder-quobyte-a35b8afa-22e2-4558-99d6-cc212fa9b2f7" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:09:52 devstack sudo[94172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5
Sep 28 18:09:52 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d64e1789-52dc-47be-9bae-39d41b31159c tempest-ServerActionsTestOtherA-595876003 None] Lock "cinder-quobyte-a35b8afa-22e2-4558-99d6-cc212fa9b2f7" acquired by "delete_volume" :: waited 0.018s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5764d9-5e65-406c-b5d6-52d1852de691]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d64e1789-52dc-47be-9bae-39d41b31159c tempest-ServerActionsTestOtherA-595876003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a35b8afa-22e2-4558-99d6-cc212fa9b2f7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:52 devstack sudo[94176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a35b8afa-22e2-4558-99d6-cc212fa9b2f7
Sep 28 18:09:52 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:52 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-3cb711ee-3c15-497e-a04f-c48b3098276f req-6f6c54a2-91c8-4c7c-ae0a-2a33ef401156 tempest-ServerActionsTestOtherA-595876003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.304s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG cinder.manager [req-3cb711ee-3c15-497e-a04f-c48b3098276f req-6f6c54a2-91c8-4c7c-ae0a-2a33ef401156 tempest-ServerActionsTestOtherA-595876003 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:09:52 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-3cb711ee-3c15-497e-a04f-c48b3098276f req-6f6c54a2-91c8-4c7c-ae0a-2a33ef401156 tempest-ServerActionsTestOtherA-595876003 None] Deleted volume successfully.
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-3cb711ee-3c15-497e-a04f-c48b3098276f req-6f6c54a2-91c8-4c7c-ae0a-2a33ef401156 tempest-ServerActionsTestOtherA-595876003 None] Lock "cinder-a65fa9a0-727a-48fb-9a12-efc0784a0df0-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:09:52 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01c9e82c-50c1-4c93-a264-25753b6bc0be tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5" returned: 0 in 0.471s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01c9e82c-50c1-4c93-a264-25753b6bc0be tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.225fc47f-3fdc-49ab-af92-d163723efbcf 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:52 devstack sudo[94182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.225fc47f-3fdc-49ab-af92-d163723efbcf 1G
Sep 28 18:09:52 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:53 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d64e1789-52dc-47be-9bae-39d41b31159c tempest-ServerActionsTestOtherA-595876003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a35b8afa-22e2-4558-99d6-cc212fa9b2f7" returned: 0 in 0.449s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d64e1789-52dc-47be-9bae-39d41b31159c tempest-ServerActionsTestOtherA-595876003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a35b8afa-22e2-4558-99d6-cc212fa9b2f7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:53 devstack sudo[94188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a35b8afa-22e2-4558-99d6-cc212fa9b2f7
Sep 28 18:09:53 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:53 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d64e1789-52dc-47be-9bae-39d41b31159c tempest-ServerActionsTestOtherA-595876003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a35b8afa-22e2-4558-99d6-cc212fa9b2f7" returned: 0 in 0.341s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:53 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01c9e82c-50c1-4c93-a264-25753b6bc0be tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.225fc47f-3fdc-49ab-af92-d163723efbcf 1G" returned: 0 in 0.540s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01c9e82c-50c1-4c93-a264-25753b6bc0be tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd51056e-9229-486a-9aee-97a63aaf4aa5 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.225fc47f-3fdc-49ab-af92-d163723efbcf {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:53 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d64e1789-52dc-47be-9bae-39d41b31159c tempest-ServerActionsTestOtherA-595876003 None] Lock "cinder-quobyte-a35b8afa-22e2-4558-99d6-cc212fa9b2f7" released by "delete_volume" :: held 0.856s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:09:53 devstack sudo[94195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd51056e-9229-486a-9aee-97a63aaf4aa5 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.225fc47f-3fdc-49ab-af92-d163723efbcf
Sep 28 18:09:53 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:53 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-d64e1789-52dc-47be-9bae-39d41b31159c tempest-ServerActionsTestOtherA-595876003 None] Created reservations ['08e8d464-a602-406d-8f54-4e8fa49c38a7', '6ef4db89-6a23-475e-a409-d788c7a095cb', 'c50126b0-3740-4656-b8ee-ca13d9fcd361', 'c92284d3-1d2c-4057-bba3-559e036f0a71'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:09:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d64e1789-52dc-47be-9bae-39d41b31159c tempest-ServerActionsTestOtherA-595876003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d64e1789-52dc-47be-9bae-39d41b31159c tempest-ServerActionsTestOtherA-595876003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d64e1789-52dc-47be-9bae-39d41b31159c tempest-ServerActionsTestOtherA-595876003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:09:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d64e1789-52dc-47be-9bae-39d41b31159c tempest-ServerActionsTestOtherA-595876003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:09:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d64e1789-52dc-47be-9bae-39d41b31159c tempest-ServerActionsTestOtherA-595876003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d64e1789-52dc-47be-9bae-39d41b31159c tempest-ServerActionsTestOtherA-595876003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:53 devstack sudo[94197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:09:53 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:53 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01c9e82c-50c1-4c93-a264-25753b6bc0be tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd51056e-9229-486a-9aee-97a63aaf4aa5 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.225fc47f-3fdc-49ab-af92-d163723efbcf" returned: 0 in 0.425s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:53 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-01c9e82c-50c1-4c93-a264-25753b6bc0be tempest-VolumesSnapshotTestJSON-1795745985 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.225fc47f-3fdc-49ab-af92-d163723efbcf is being set with open permissions: ugo+rw
Sep 28 18:09:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01c9e82c-50c1-4c93-a264-25753b6bc0be tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.225fc47f-3fdc-49ab-af92-d163723efbcf {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:53 devstack sudo[94203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.225fc47f-3fdc-49ab-af92-d163723efbcf
Sep 28 18:09:53 devstack sudo[94203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:54 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:09:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Flow 'volume_create_manager' (42573d88-346a-41b8-9bce-27eefdd49e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:09:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3128bf7-aaa3-46fa-85b5-a370feaee8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:54 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d64e1789-52dc-47be-9bae-39d41b31159c tempest-ServerActionsTestOtherA-595876003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.482s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:54 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d64e1789-52dc-47be-9bae-39d41b31159c tempest-ServerActionsTestOtherA-595876003 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:09:54 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d64e1789-52dc-47be-9bae-39d41b31159c tempest-ServerActionsTestOtherA-595876003 None] Deleted volume successfully.
Sep 28 18:09:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3128bf7-aaa3-46fa-85b5-a370feaee8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1149892809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1018d898-af5d-4227-8b16-a00024c04fbf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d09f189f2d664f87b62783366f9738f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:54Z,use_quota=True,user_id='a8793fa942d541d4b04b693c927ffddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc95695-53db-4bd5-acec-5da6f1824818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc95695-53db-4bd5-acec-5da6f1824818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6de8652-240a-4641-b4b2-5941ded2e699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6de8652-240a-4641-b4b2-5941ded2e699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1018d898-af5d-4227-8b16-a00024c04fbf', 'volume_name': 'volume-1018d898-af5d-4227-8b16-a00024c04fbf', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f208488-ec83-49e3-92a4-3821e2f5ffd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f208488-ec83-49e3-92a4-3821e2f5ffd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd96171-2989-41f6-9237-b9ea99edf047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:54 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Volume 1018d898-af5d-4227-8b16-a00024c04fbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1018d898-af5d-4227-8b16-a00024c04fbf', 'volume_size': 1}
Sep 28 18:09:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:54 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d64e1789-52dc-47be-9bae-39d41b31159c tempest-ServerActionsTestOtherA-595876003 None] Lock "cinder-a35b8afa-22e2-4558-99d6-cc212fa9b2f7-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:09:54 devstack sudo[94203]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01c9e82c-50c1-4c93-a264-25753b6bc0be tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.225fc47f-3fdc-49ab-af92-d163723efbcf" returned: 0 in 0.434s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01c9e82c-50c1-4c93-a264-25753b6bc0be tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:54 devstack sudo[94212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.info
Sep 28 18:09:54 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:54 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01c9e82c-50c1-4c93-a264-25753b6bc0be tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.info" returned: 0 in 0.379s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:54 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-01c9e82c-50c1-4c93-a264-25753b6bc0be tempest-VolumesSnapshotTestJSON-1795745985 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.info is being set with open permissions: ugo+rw
Sep 28 18:09:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01c9e82c-50c1-4c93-a264-25753b6bc0be tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:54 devstack sudo[94234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.info
Sep 28 18:09:54 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:55 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01c9e82c-50c1-4c93-a264-25753b6bc0be tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.info" returned: 0 in 0.333s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-01c9e82c-50c1-4c93-a264-25753b6bc0be tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.724s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.874s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1149892809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1018d898-af5d-4227-8b16-a00024c04fbf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d09f189f2d664f87b62783366f9738f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:54Z,use_quota=True,user_id='a8793fa942d541d4b04b693c927ffddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:09:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Creating volume 1018d898-af5d-4227-8b16-a00024c04fbf {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:09:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:09:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:09:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:09:55 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:09:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1018d898-af5d-4227-8b16-a00024c04fbf 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:55 devstack sudo[94238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1018d898-af5d-4227-8b16-a00024c04fbf 1073741824
Sep 28 18:09:55 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:55 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-01c9e82c-50c1-4c93-a264-25753b6bc0be tempest-VolumesSnapshotTestJSON-1795745985 None] Create snapshot completed successfully
Sep 28 18:09:55 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-43a1e70e-8218-48a8-b1d0-cb2612fc1b3b tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-225fc47f-3fdc-49ab-af92-d163723efbcf-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:09:55 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-43a1e70e-8218-48a8-b1d0-cb2612fc1b3b tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-225fc47f-3fdc-49ab-af92-d163723efbcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:09:55 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1018d898-af5d-4227-8b16-a00024c04fbf 1073741824" returned: 0 in 0.753s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-43a1e70e-8218-48a8-b1d0-cb2612fc1b3b tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-quobyte-dd51056e-9229-486a-9aee-97a63aaf4aa5" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:09:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-43a1e70e-8218-48a8-b1d0-cb2612fc1b3b tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-dd51056e-9229-486a-9aee-97a63aaf4aa5" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:09:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-43a1e70e-8218-48a8-b1d0-cb2612fc1b3b tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-quobyte-225fc47f-3fdc-49ab-af92-d163723efbcf" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:09:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1018d898-af5d-4227-8b16-a00024c04fbf {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-43a1e70e-8218-48a8-b1d0-cb2612fc1b3b tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-225fc47f-3fdc-49ab-af92-d163723efbcf" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:09:56 devstack sudo[94246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1018d898-af5d-4227-8b16-a00024c04fbf
Sep 28 18:09:56 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-43a1e70e-8218-48a8-b1d0-cb2612fc1b3b tempest-VolumesSnapshotTestJSON-1795745985 None] Deleting offline snapshot 225fc47f-3fdc-49ab-af92-d163723efbcf of volume dd51056e-9229-486a-9aee-97a63aaf4aa5 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:09:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-43a1e70e-8218-48a8-b1d0-cb2612fc1b3b tempest-VolumesSnapshotTestJSON-1795745985 None] snapshot_file for this snap is: volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.225fc47f-3fdc-49ab-af92-d163723efbcf {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:09:56 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c37a21-3cad-47b4-a813-ec732c52a781]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:09:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-43a1e70e-8218-48a8-b1d0-cb2612fc1b3b tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.225fc47f-3fdc-49ab-af92-d163723efbcf {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:56 devstack sudo[94250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.225fc47f-3fdc-49ab-af92-d163723efbcf
Sep 28 18:09:56 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:56 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1018d898-af5d-4227-8b16-a00024c04fbf" returned: 0 in 0.368s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:09:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd96171-2989-41f6-9237-b9ea99edf047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1018d898-af5d-4227-8b16-a00024c04fbf', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90630f83-d672-4bf2-997c-2ea97ae4e4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:56 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Volume volume-1018d898-af5d-4227-8b16-a00024c04fbf (1018d898-af5d-4227-8b16-a00024c04fbf): created successfully
Sep 28 18:09:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90630f83-d672-4bf2-997c-2ea97ae4e4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Flow 'volume_create_manager' (42573d88-346a-41b8-9bce-27eefdd49e20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:09:56 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-310953cf-276c-4f88-9dc9-b228d41b7273 tempest-VolumesTestJSON-2129929835 None] Created volume successfully.
Sep 28 18:09:56 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-43a1e70e-8218-48a8-b1d0-cb2612fc1b3b tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.225fc47f-3fdc-49ab-af92-d163723efbcf" returned: 0 in 0.522s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-43a1e70e-8218-48a8-b1d0-cb2612fc1b3b tempest-VolumesSnapshotTestJSON-1795745985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd51056e-9229-486a-9aee-97a63aaf4aa5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:09:56 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8be668-c947-467e-840d-5eb780701088]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:09:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-43a1e70e-8218-48a8-b1d0-cb2612fc1b3b tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:56 devstack sudo[94257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5
Sep 28 18:09:56 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:57 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-43a1e70e-8218-48a8-b1d0-cb2612fc1b3b tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5" returned: 0 in 0.550s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-43a1e70e-8218-48a8-b1d0-cb2612fc1b3b tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.225fc47f-3fdc-49ab-af92-d163723efbcf {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:57 devstack sudo[94267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.225fc47f-3fdc-49ab-af92-d163723efbcf
Sep 28 18:09:57 devstack sudo[94267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:57 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-802293bf-7834-4a94-8a37-5cd1fd0c3010 req-8c2869a8-35e6-4f4c-8bd3-4d41bfbe6549 tempest-AttachVolumeTestJSON-721645988 None] Terminate volume connection completed successfully.
Sep 28 18:09:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-802293bf-7834-4a94-8a37-5cd1fd0c3010 req-8c2869a8-35e6-4f4c-8bd3-4d41bfbe6549 tempest-AttachVolumeTestJSON-721645988 None] Deleting attachment 0d6e8148-2c78-4674-b64d-646c997073ce. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:09:57 devstack sudo[94267]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-43a1e70e-8218-48a8-b1d0-cb2612fc1b3b tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.225fc47f-3fdc-49ab-af92-d163723efbcf" returned: 0 in 0.599s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-43a1e70e-8218-48a8-b1d0-cb2612fc1b3b tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.225fc47f-3fdc-49ab-af92-d163723efbcf {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:57 devstack sudo[94281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.225fc47f-3fdc-49ab-af92-d163723efbcf
Sep 28 18:09:57 devstack sudo[94281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:58 devstack sudo[94281]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-43a1e70e-8218-48a8-b1d0-cb2612fc1b3b tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5.225fc47f-3fdc-49ab-af92-d163723efbcf" returned: 0 in 0.680s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-43a1e70e-8218-48a8-b1d0-cb2612fc1b3b tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-225fc47f-3fdc-49ab-af92-d163723efbcf" released by "_delete_snapshot" :: held 2.553s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:09:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-43a1e70e-8218-48a8-b1d0-cb2612fc1b3b tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-dd51056e-9229-486a-9aee-97a63aaf4aa5" released by "delete_snapshot" :: held 2.607s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:09:58 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-43a1e70e-8218-48a8-b1d0-cb2612fc1b3b tempest-VolumesSnapshotTestJSON-1795745985 None] Created reservations ['37de0471-18c8-416d-9060-a30598adf874', '19b5976e-5f45-4b61-830e-2b3b62f614b6', 'fab7b1aa-8cf8-477a-8028-caaeb71b0323', '244a0507-5776-4cc9-82da-7a60029a56d2'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:09:58 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-43a1e70e-8218-48a8-b1d0-cb2612fc1b3b tempest-VolumesSnapshotTestJSON-1795745985 None] Delete snapshot completed successfully.
Sep 28 18:09:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-43a1e70e-8218-48a8-b1d0-cb2612fc1b3b tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-225fc47f-3fdc-49ab-af92-d163723efbcf-delete_snapshot" released by "delete_snapshot" :: held 2.979s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:09:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-514a3ef3-8270-4bf2-aa76-70ae0e192131 tempest-VolumesTestJSON-2129929835 None] Acquiring lock "cinder-1018d898-af5d-4227-8b16-a00024c04fbf-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:09:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-514a3ef3-8270-4bf2-aa76-70ae0e192131 tempest-VolumesTestJSON-2129929835 None] Lock "cinder-1018d898-af5d-4227-8b16-a00024c04fbf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-514a3ef3-8270-4bf2-aa76-70ae0e192131 tempest-VolumesTestJSON-2129929835 None] Acquiring lock "cinder-quobyte-1018d898-af5d-4227-8b16-a00024c04fbf" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-514a3ef3-8270-4bf2-aa76-70ae0e192131 tempest-VolumesTestJSON-2129929835 None] Lock "cinder-quobyte-1018d898-af5d-4227-8b16-a00024c04fbf" acquired by "delete_volume" :: waited 0.031s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8de7a3-f7d9-4acb-8f04-064ef596fc4d]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-514a3ef3-8270-4bf2-aa76-70ae0e192131 tempest-VolumesTestJSON-2129929835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1018d898-af5d-4227-8b16-a00024c04fbf {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:59 devstack sudo[94292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1018d898-af5d-4227-8b16-a00024c04fbf
Sep 28 18:09:59 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:59 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-514a3ef3-8270-4bf2-aa76-70ae0e192131 tempest-VolumesTestJSON-2129929835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1018d898-af5d-4227-8b16-a00024c04fbf" returned: 0 in 0.507s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-514a3ef3-8270-4bf2-aa76-70ae0e192131 tempest-VolumesTestJSON-2129929835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1018d898-af5d-4227-8b16-a00024c04fbf {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:09:59 devstack sudo[94303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1018d898-af5d-4227-8b16-a00024c04fbf
Sep 28 18:09:59 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Flow 'volume_create_manager' (8bd0a8cc-77a7-467a-8902-6b28d67832cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1faa4ef-7f3c-4b4b-b78f-8239cfdbd5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:59 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1faa4ef-7f3c-4b4b-b78f-8239cfdbd5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1442534069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70396b4a-92e9-4160-aff0-bf31e85eb9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb286279ad05458b8a6745411d252e69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:00Z,use_quota=True,user_id='2116c58e4be6429ea7b907aa247d3b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d02da004-dc20-4cbd-97a4-c7dd51ff7502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d02da004-dc20-4cbd-97a4-c7dd51ff7502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51cab585-14c4-4590-a595-1b93932c6585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51cab585-14c4-4590-a595-1b93932c6585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70396b4a-92e9-4160-aff0-bf31e85eb9af', 'volume_name': 'volume-70396b4a-92e9-4160-aff0-bf31e85eb9af', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e1524eb-c67b-4bed-982c-01a595e88541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e1524eb-c67b-4bed-982c-01a595e88541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e364328b-a8df-40cd-9708-67e4e138271d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:09:59 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Volume 70396b4a-92e9-4160-aff0-bf31e85eb9af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70396b4a-92e9-4160-aff0-bf31e85eb9af', 'volume_size': 1}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1442534069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70396b4a-92e9-4160-aff0-bf31e85eb9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb286279ad05458b8a6745411d252e69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:00Z,use_quota=True,user_id='2116c58e4be6429ea7b907aa247d3b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Creating volume 70396b4a-92e9-4160-aff0-bf31e85eb9af {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:09:59 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:09:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-514a3ef3-8270-4bf2-aa76-70ae0e192131 tempest-VolumesTestJSON-2129929835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1018d898-af5d-4227-8b16-a00024c04fbf" returned: 0 in 0.377s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-514a3ef3-8270-4bf2-aa76-70ae0e192131 tempest-VolumesTestJSON-2129929835 None] Lock "cinder-quobyte-1018d898-af5d-4227-8b16-a00024c04fbf" released by "delete_volume" :: held 0.953s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:10:00 devstack sudo[94306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af 1073741824
Sep 28 18:10:00 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:00 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-514a3ef3-8270-4bf2-aa76-70ae0e192131 tempest-VolumesTestJSON-2129929835 None] Created reservations ['ecdf195b-e2a7-412e-8255-15ebe792e355', 'b42c13f9-6f7b-45cb-9d6a-1961651ed48d', '5f2ba8a8-46e5-436f-a18f-b7e3b91aacbb', 'b0fe9f4f-ae5f-44b8-97e6-aed6999352d5'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:10:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-514a3ef3-8270-4bf2-aa76-70ae0e192131 tempest-VolumesTestJSON-2129929835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-514a3ef3-8270-4bf2-aa76-70ae0e192131 tempest-VolumesTestJSON-2129929835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-514a3ef3-8270-4bf2-aa76-70ae0e192131 tempest-VolumesTestJSON-2129929835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:10:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-514a3ef3-8270-4bf2-aa76-70ae0e192131 tempest-VolumesTestJSON-2129929835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:10:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-514a3ef3-8270-4bf2-aa76-70ae0e192131 tempest-VolumesTestJSON-2129929835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-514a3ef3-8270-4bf2-aa76-70ae0e192131 tempest-VolumesTestJSON-2129929835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:00 devstack sudo[94308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:10:00 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:00 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-514a3ef3-8270-4bf2-aa76-70ae0e192131 tempest-VolumesTestJSON-2129929835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.412s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:00 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-514a3ef3-8270-4bf2-aa76-70ae0e192131 tempest-VolumesTestJSON-2129929835 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:10:00 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-514a3ef3-8270-4bf2-aa76-70ae0e192131 tempest-VolumesTestJSON-2129929835 None] Deleted volume successfully.
Sep 28 18:10:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-514a3ef3-8270-4bf2-aa76-70ae0e192131 tempest-VolumesTestJSON-2129929835 None] Lock "cinder-1018d898-af5d-4227-8b16-a00024c04fbf-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:10:00 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af 1073741824" returned: 0 in 0.734s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:00 devstack sudo[94315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af
Sep 28 18:10:00 devstack sudo[94315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:01 devstack sudo[94315]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af" returned: 0 in 0.367s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:10:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e364328b-a8df-40cd-9708-67e4e138271d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70396b4a-92e9-4160-aff0-bf31e85eb9af', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4afe39ad-10f3-400f-bcf0-8acc0c06dbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:01 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Volume volume-70396b4a-92e9-4160-aff0-bf31e85eb9af (70396b4a-92e9-4160-aff0-bf31e85eb9af): created successfully
Sep 28 18:10:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4afe39ad-10f3-400f-bcf0-8acc0c06dbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Flow 'volume_create_manager' (8bd0a8cc-77a7-467a-8902-6b28d67832cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:10:01 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-8b70fcc4-7031-48b0-bcd1-f8b623aa8347 tempest-VolumesSnapshotTestJSON-1795745985 None] Created volume successfully.
Sep 28 18:10:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b068cc16-12e6-40c6-aada-16cbc182c058 tempest-VolumesTestJSON-2129929835 None] Acquiring lock "cinder-539ee38b-4f1a-4a31-813c-fae0e65ad703-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:10:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b068cc16-12e6-40c6-aada-16cbc182c058 tempest-VolumesTestJSON-2129929835 None] Lock "cinder-539ee38b-4f1a-4a31-813c-fae0e65ad703-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:10:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b068cc16-12e6-40c6-aada-16cbc182c058 tempest-VolumesTestJSON-2129929835 None] Acquiring lock "cinder-quobyte-539ee38b-4f1a-4a31-813c-fae0e65ad703" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:10:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b068cc16-12e6-40c6-aada-16cbc182c058 tempest-VolumesTestJSON-2129929835 None] Lock "cinder-quobyte-539ee38b-4f1a-4a31-813c-fae0e65ad703" acquired by "delete_volume" :: waited 0.023s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:10:01 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c560bd89-eefd-4822-a3d0-0af19770577a]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:10:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b068cc16-12e6-40c6-aada-16cbc182c058 tempest-VolumesTestJSON-2129929835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-539ee38b-4f1a-4a31-813c-fae0e65ad703 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:01 devstack sudo[94322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-539ee38b-4f1a-4a31-813c-fae0e65ad703
Sep 28 18:10:01 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:02 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b068cc16-12e6-40c6-aada-16cbc182c058 tempest-VolumesTestJSON-2129929835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-539ee38b-4f1a-4a31-813c-fae0e65ad703" returned: 0 in 0.592s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b068cc16-12e6-40c6-aada-16cbc182c058 tempest-VolumesTestJSON-2129929835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-539ee38b-4f1a-4a31-813c-fae0e65ad703 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:02 devstack sudo[94345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-539ee38b-4f1a-4a31-813c-fae0e65ad703
Sep 28 18:10:02 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:02 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b068cc16-12e6-40c6-aada-16cbc182c058 tempest-VolumesTestJSON-2129929835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-539ee38b-4f1a-4a31-813c-fae0e65ad703" returned: 0 in 0.562s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:02 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b068cc16-12e6-40c6-aada-16cbc182c058 tempest-VolumesTestJSON-2129929835 None] Lock "cinder-quobyte-539ee38b-4f1a-4a31-813c-fae0e65ad703" released by "delete_volume" :: held 1.215s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:10:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e025f14b-da30-4856-af94-b541539cf0c4 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e025f14b-da30-4856-af94-b541539cf0c4 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:02 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-e025f14b-da30-4856-af94-b541539cf0c4 tempest-VolumesSnapshotTestJSON-1795745985 None] Creating offline snapshot b2ee4cdb-53f5-45e0-82ea-df75d93fb271 of volume 70396b4a-92e9-4160-aff0-bf31e85eb9af {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:10:02 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e52a8e2-68e4-4adb-beba-957e94ca5698]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:10:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e025f14b-da30-4856-af94-b541539cf0c4 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:02 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-b068cc16-12e6-40c6-aada-16cbc182c058 tempest-VolumesTestJSON-2129929835 None] Created reservations ['68b9e4ec-21c1-4504-a9bd-33d0c221845a', 'f749f968-445d-4dd0-92c2-2567135fc61f', '3702fc59-9454-4942-9c41-25123df2fe62', '04d3dc47-acb5-4a2c-875c-230301c6364f'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:10:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b068cc16-12e6-40c6-aada-16cbc182c058 tempest-VolumesTestJSON-2129929835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b068cc16-12e6-40c6-aada-16cbc182c058 tempest-VolumesTestJSON-2129929835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:02 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b068cc16-12e6-40c6-aada-16cbc182c058 tempest-VolumesTestJSON-2129929835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:10:02 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b068cc16-12e6-40c6-aada-16cbc182c058 tempest-VolumesTestJSON-2129929835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:10:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b068cc16-12e6-40c6-aada-16cbc182c058 tempest-VolumesTestJSON-2129929835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b068cc16-12e6-40c6-aada-16cbc182c058 tempest-VolumesTestJSON-2129929835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:02 devstack sudo[94356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af
Sep 28 18:10:02 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:02 devstack sudo[94361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:10:02 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:03 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b068cc16-12e6-40c6-aada-16cbc182c058 tempest-VolumesTestJSON-2129929835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.471s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:03 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-b068cc16-12e6-40c6-aada-16cbc182c058 tempest-VolumesTestJSON-2129929835 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:10:03 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-b068cc16-12e6-40c6-aada-16cbc182c058 tempest-VolumesTestJSON-2129929835 None] Deleted volume successfully.
Sep 28 18:10:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b068cc16-12e6-40c6-aada-16cbc182c058 tempest-VolumesTestJSON-2129929835 None] Lock "cinder-539ee38b-4f1a-4a31-813c-fae0e65ad703-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:10:03 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e025f14b-da30-4856-af94-b541539cf0c4 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af" returned: 0 in 0.885s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e025f14b-da30-4856-af94-b541539cf0c4 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:03 devstack sudo[94404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271 1G
Sep 28 18:10:03 devstack sudo[94404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f471105e-41b9-4b96-a8b2-17a35e751219 tempest-VolumesTestJSON-2129929835 None] Acquiring lock "cinder-077bf7d1-1c33-4dce-b5da-9b6737e7b80f-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:10:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f471105e-41b9-4b96-a8b2-17a35e751219 tempest-VolumesTestJSON-2129929835 None] Lock "cinder-077bf7d1-1c33-4dce-b5da-9b6737e7b80f-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:10:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f471105e-41b9-4b96-a8b2-17a35e751219 tempest-VolumesTestJSON-2129929835 None] Acquiring lock "cinder-quobyte-077bf7d1-1c33-4dce-b5da-9b6737e7b80f" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:10:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f471105e-41b9-4b96-a8b2-17a35e751219 tempest-VolumesTestJSON-2129929835 None] Lock "cinder-quobyte-077bf7d1-1c33-4dce-b5da-9b6737e7b80f" acquired by "delete_volume" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:10:04 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4e767c-0990-4d61-a439-299416e496c0]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:10:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f471105e-41b9-4b96-a8b2-17a35e751219 tempest-VolumesTestJSON-2129929835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-077bf7d1-1c33-4dce-b5da-9b6737e7b80f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:04 devstack sudo[94422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-077bf7d1-1c33-4dce-b5da-9b6737e7b80f
Sep 28 18:10:04 devstack sudo[94422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:04 devstack sudo[94404]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e025f14b-da30-4856-af94-b541539cf0c4 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271 1G" returned: 0 in 0.853s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e025f14b-da30-4856-af94-b541539cf0c4 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70396b4a-92e9-4160-aff0-bf31e85eb9af -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:04 devstack sudo[94437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70396b4a-92e9-4160-aff0-bf31e85eb9af -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271
Sep 28 18:10:04 devstack sudo[94437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:04 devstack sudo[94422]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f471105e-41b9-4b96-a8b2-17a35e751219 tempest-VolumesTestJSON-2129929835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-077bf7d1-1c33-4dce-b5da-9b6737e7b80f" returned: 0 in 0.645s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f471105e-41b9-4b96-a8b2-17a35e751219 tempest-VolumesTestJSON-2129929835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-077bf7d1-1c33-4dce-b5da-9b6737e7b80f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:04 devstack sudo[94448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-077bf7d1-1c33-4dce-b5da-9b6737e7b80f
Sep 28 18:10:04 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:04 devstack sudo[94437]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e025f14b-da30-4856-af94-b541539cf0c4 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70396b4a-92e9-4160-aff0-bf31e85eb9af -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271" returned: 0 in 0.509s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:04 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-e025f14b-da30-4856-af94-b541539cf0c4 tempest-VolumesSnapshotTestJSON-1795745985 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271 is being set with open permissions: ugo+rw
Sep 28 18:10:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e025f14b-da30-4856-af94-b541539cf0c4 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:05 devstack sudo[94467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271
Sep 28 18:10:05 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:05 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f471105e-41b9-4b96-a8b2-17a35e751219 tempest-VolumesTestJSON-2129929835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-077bf7d1-1c33-4dce-b5da-9b6737e7b80f" returned: 0 in 0.484s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f471105e-41b9-4b96-a8b2-17a35e751219 tempest-VolumesTestJSON-2129929835 None] Lock "cinder-quobyte-077bf7d1-1c33-4dce-b5da-9b6737e7b80f" released by "delete_volume" :: held 1.202s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:10:05 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-f471105e-41b9-4b96-a8b2-17a35e751219 tempest-VolumesTestJSON-2129929835 None] Created reservations ['3d6f7d57-c90f-4008-b90f-1ff36a913e9c', 'af4e39c6-dd78-4ae0-8596-9d509cd66452', '48c8363b-1d78-463f-9c0f-cb7794cc00ac', 'e3f38470-788a-4d9a-8d84-be46b9fab176'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:10:05 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e025f14b-da30-4856-af94-b541539cf0c4 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271" returned: 0 in 0.396s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e025f14b-da30-4856-af94-b541539cf0c4 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f471105e-41b9-4b96-a8b2-17a35e751219 tempest-VolumesTestJSON-2129929835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f471105e-41b9-4b96-a8b2-17a35e751219 tempest-VolumesTestJSON-2129929835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f471105e-41b9-4b96-a8b2-17a35e751219 tempest-VolumesTestJSON-2129929835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:10:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f471105e-41b9-4b96-a8b2-17a35e751219 tempest-VolumesTestJSON-2129929835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:10:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f471105e-41b9-4b96-a8b2-17a35e751219 tempest-VolumesTestJSON-2129929835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f471105e-41b9-4b96-a8b2-17a35e751219 tempest-VolumesTestJSON-2129929835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:05 devstack sudo[94471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.info
Sep 28 18:10:05 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:05 devstack sudo[94472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:10:05 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:05 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f471105e-41b9-4b96-a8b2-17a35e751219 tempest-VolumesTestJSON-2129929835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.469s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:05 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-f471105e-41b9-4b96-a8b2-17a35e751219 tempest-VolumesTestJSON-2129929835 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:10:05 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-f471105e-41b9-4b96-a8b2-17a35e751219 tempest-VolumesTestJSON-2129929835 None] Deleted volume successfully.
Sep 28 18:10:05 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e025f14b-da30-4856-af94-b541539cf0c4 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.info" returned: 0 in 0.519s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:05 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-e025f14b-da30-4856-af94-b541539cf0c4 tempest-VolumesSnapshotTestJSON-1795745985 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.info is being set with open permissions: ugo+rw
Sep 28 18:10:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e025f14b-da30-4856-af94-b541539cf0c4 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:06 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f471105e-41b9-4b96-a8b2-17a35e751219 tempest-VolumesTestJSON-2129929835 None] Lock "cinder-077bf7d1-1c33-4dce-b5da-9b6737e7b80f-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:10:06 devstack sudo[94477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.info
Sep 28 18:10:06 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:06 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e025f14b-da30-4856-af94-b541539cf0c4 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.info" returned: 0 in 0.494s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e025f14b-da30-4856-af94-b541539cf0c4 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.856s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:06 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-e025f14b-da30-4856-af94-b541539cf0c4 tempest-VolumesSnapshotTestJSON-1795745985 None] Create snapshot completed successfully
Sep 28 18:10:07 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Flow 'volume_create_manager' (2b9e108b-4ec8-4d6b-85e6-44172cebbd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e42265c-06fa-4f12-9848-51b5f159f8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e42265c-06fa-4f12-9848-51b5f159f8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-19435410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd24ecf9-db6a-4814-84d3-fae5429acd9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb286279ad05458b8a6745411d252e69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b2ee4cdb-53f5-45e0-82ea-df75d93fb271,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:08Z,use_quota=True,user_id='2116c58e4be6429ea7b907aa247d3b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7afbe4f4-f8ce-4090-b535-b832d1d7e530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7afbe4f4-f8ce-4090-b535-b832d1d7e530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33434629-46b1-403b-97ce-9517c14a3219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33434629-46b1-403b-97ce-9517c14a3219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bd24ecf9-db6a-4814-84d3-fae5429acd9a', 'volume_name': 'volume-bd24ecf9-db6a-4814-84d3-fae5429acd9a', 'volume_size': 2, 'snapshot_id': 'b2ee4cdb-53f5-45e0-82ea-df75d93fb271'}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f304c2be-6b87-482c-be2e-62fd84f27264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f304c2be-6b87-482c-be2e-62fd84f27264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7660b052-dc42-465a-afaf-b4fc6276dd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:08 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Volume bd24ecf9-db6a-4814-84d3-fae5429acd9a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bd24ecf9-db6a-4814-84d3-fae5429acd9a', 'volume_size': 2, 'snapshot_id': 'b2ee4cdb-53f5-45e0-82ea-df75d93fb271'}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-quobyte-b2ee4cdb-53f5-45e0-82ea-df75d93fb271-bd24ecf9-db6a-4814-84d3-fae5429acd9a" by "_create_volume_from_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-b2ee4cdb-53f5-45e0-82ea-df75d93fb271-bd24ecf9-db6a-4814-84d3-fae5429acd9a" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Creating volume bd24ecf9-db6a-4814-84d3-fae5429acd9a from snapshot b2ee4cdb-53f5-45e0-82ea-df75d93fb271 {{(pid=87046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-quobyte-bd24ecf9-db6a-4814-84d3-fae5429acd9a" by "_copy_volume_from_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-bd24ecf9-db6a-4814-84d3-fae5429acd9a" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] snapshot: b2ee4cdb-53f5-45e0-82ea-df75d93fb271, volume: bd24ecf9-db6a-4814-84d3-fae5429acd9a,  {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7622ceca-7b83-4906-a0bc-1e83f69db1c6]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:10:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:08 devstack sudo[94484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271
Sep 28 18:10:08 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:09 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271" returned: 0 in 0.701s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70396b4a-92e9-4160-aff0-bf31e85eb9af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:10:09 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e7ffe9-8ab2-4671-abf5-e3d11018b9f7]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:10:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:09 devstack sudo[94489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af
Sep 28 18:10:09 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:09 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af" returned: 0 in 0.548s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 28 18:10:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Creating direct copy from snapshot {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 28 18:10:09 devstack cinder-volume[87046]: DEBUG cinder.utils [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Path /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bd24ecf9-db6a-4814-84d3-fae5429acd9a not found in is_blk_device check {{(pid=87046) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 28 18:10:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bd24ecf9-db6a-4814-84d3-fae5429acd9a {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:09 devstack sudo[94494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bd24ecf9-db6a-4814-84d3-fae5429acd9a
Sep 28 18:10:09 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06c2da6b-dfd5-4752-8b94-7c1a56e80d5c tempest-BackendsCapabilitiesAdminTestsJSON-1063850405 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.122184753418, 'free_capacity_gb': 1775.122184753418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87046) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 28 18:10:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e89d2299-a316-424c-9d01-2df3a53c8a79 tempest-BackendsCapabilitiesAdminTestsJSON-1063850405 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.122184753418, 'free_capacity_gb': 1775.122184753418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87046) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 28 18:10:18 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=50,cinder:UPDATE=61,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:10:18 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:UPDATE=68,cinder:SELECT=65,cinder:DELETE=5,cinder:INSERT=9 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:10:20 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bd24ecf9-db6a-4814-84d3-fae5429acd9a" returned: 0 in 10.390s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:20 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Image conversion details: src /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af, size 1024.00 MB, duration 10.39 sec, destination /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bd24ecf9-db6a-4814-84d3-fae5429acd9a {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:10:20 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Converted 1024.00 MB image at 98.54 MB/s
Sep 28 18:10:20 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bd24ecf9-db6a-4814-84d3-fae5429acd9a is being set with open permissions: ugo+rw
Sep 28 18:10:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bd24ecf9-db6a-4814-84d3-fae5429acd9a {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:20 devstack sudo[94559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bd24ecf9-db6a-4814-84d3-fae5429acd9a
Sep 28 18:10:20 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:20 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bd24ecf9-db6a-4814-84d3-fae5429acd9a" returned: 0 in 0.370s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:20 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-bd24ecf9-db6a-4814-84d3-fae5429acd9a" released by "_copy_volume_from_snapshot" :: held 12.167s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:10:20 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-b2ee4cdb-53f5-45e0-82ea-df75d93fb271-bd24ecf9-db6a-4814-84d3-fae5429acd9a" released by "_create_volume_from_snapshot" :: held 12.286s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:10:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.313s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7660b052-dc42-465a-afaf-b4fc6276dd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd24ecf9-db6a-4814-84d3-fae5429acd9a', 'volume_size': 2, 'snapshot_id': 'b2ee4cdb-53f5-45e0-82ea-df75d93fb271'}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c96801-6159-4124-9794-ed68d7edebbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:20 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Volume volume-bd24ecf9-db6a-4814-84d3-fae5429acd9a (bd24ecf9-db6a-4814-84d3-fae5429acd9a): created successfully
Sep 28 18:10:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c96801-6159-4124-9794-ed68d7edebbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Flow 'volume_create_manager' (2b9e108b-4ec8-4d6b-85e6-44172cebbd88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:10:20 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-3315dabf-9fc8-4ed7-b400-1a8ba5e9bbf4 tempest-VolumesSnapshotTestJSON-1795745985 None] Created volume successfully.
Sep 28 18:10:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-46ba5d0c-9909-4099-9843-f73e8c6afefa tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-bd24ecf9-db6a-4814-84d3-fae5429acd9a-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:10:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-46ba5d0c-9909-4099-9843-f73e8c6afefa tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-bd24ecf9-db6a-4814-84d3-fae5429acd9a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:10:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-46ba5d0c-9909-4099-9843-f73e8c6afefa tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-quobyte-bd24ecf9-db6a-4814-84d3-fae5429acd9a" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:10:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-46ba5d0c-9909-4099-9843-f73e8c6afefa tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-bd24ecf9-db6a-4814-84d3-fae5429acd9a" acquired by "delete_volume" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:10:21 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a43d9ca-28dd-460c-9ae5-13fb5578b5a3]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:10:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46ba5d0c-9909-4099-9843-f73e8c6afefa tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bd24ecf9-db6a-4814-84d3-fae5429acd9a {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:21 devstack sudo[94565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bd24ecf9-db6a-4814-84d3-fae5429acd9a
Sep 28 18:10:21 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:21 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46ba5d0c-9909-4099-9843-f73e8c6afefa tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bd24ecf9-db6a-4814-84d3-fae5429acd9a" returned: 0 in 0.495s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46ba5d0c-9909-4099-9843-f73e8c6afefa tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bd24ecf9-db6a-4814-84d3-fae5429acd9a {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:21 devstack sudo[94571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bd24ecf9-db6a-4814-84d3-fae5429acd9a
Sep 28 18:10:21 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:22 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46ba5d0c-9909-4099-9843-f73e8c6afefa tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bd24ecf9-db6a-4814-84d3-fae5429acd9a" returned: 0 in 0.312s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-46ba5d0c-9909-4099-9843-f73e8c6afefa tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-bd24ecf9-db6a-4814-84d3-fae5429acd9a" released by "delete_volume" :: held 0.878s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:10:22 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-46ba5d0c-9909-4099-9843-f73e8c6afefa tempest-VolumesSnapshotTestJSON-1795745985 None] Created reservations ['c3a0cbc8-ba8d-4fd2-a5c7-739ac256a684', '47636a9a-7f3a-46b7-99f8-7265a3b4c100', '458b7eca-82e1-4894-a7ec-84e96e3850d5', '9cb1c1c6-dfa9-41a1-8ad5-ee82084aea0f'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:10:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-46ba5d0c-9909-4099-9843-f73e8c6afefa tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-46ba5d0c-9909-4099-9843-f73e8c6afefa tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:22 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-46ba5d0c-9909-4099-9843-f73e8c6afefa tempest-VolumesSnapshotTestJSON-1795745985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:10:22 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-46ba5d0c-9909-4099-9843-f73e8c6afefa tempest-VolumesSnapshotTestJSON-1795745985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:10:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-46ba5d0c-9909-4099-9843-f73e8c6afefa tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46ba5d0c-9909-4099-9843-f73e8c6afefa tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:22 devstack sudo[94575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:10:22 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-39f52f7c-062d-412e-be70-dcf796cdda42 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-b2ee4cdb-53f5-45e0-82ea-df75d93fb271-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:10:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-39f52f7c-062d-412e-be70-dcf796cdda42 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-b2ee4cdb-53f5-45e0-82ea-df75d93fb271-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:10:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-39f52f7c-062d-412e-be70-dcf796cdda42 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-quobyte-70396b4a-92e9-4160-aff0-bf31e85eb9af" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:10:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-39f52f7c-062d-412e-be70-dcf796cdda42 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-70396b4a-92e9-4160-aff0-bf31e85eb9af" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:10:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-39f52f7c-062d-412e-be70-dcf796cdda42 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-quobyte-b2ee4cdb-53f5-45e0-82ea-df75d93fb271" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:10:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-39f52f7c-062d-412e-be70-dcf796cdda42 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-b2ee4cdb-53f5-45e0-82ea-df75d93fb271" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:10:22 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-39f52f7c-062d-412e-be70-dcf796cdda42 tempest-VolumesSnapshotTestJSON-1795745985 None] Deleting offline snapshot b2ee4cdb-53f5-45e0-82ea-df75d93fb271 of volume 70396b4a-92e9-4160-aff0-bf31e85eb9af {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:10:22 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-39f52f7c-062d-412e-be70-dcf796cdda42 tempest-VolumesSnapshotTestJSON-1795745985 None] snapshot_file for this snap is: volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:10:22 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dcbf5a-4810-4c80-a376-5fcfae45e526]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:10:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-39f52f7c-062d-412e-be70-dcf796cdda42 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:22 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46ba5d0c-9909-4099-9843-f73e8c6afefa tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.392s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:22 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-46ba5d0c-9909-4099-9843-f73e8c6afefa tempest-VolumesSnapshotTestJSON-1795745985 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:10:22 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-46ba5d0c-9909-4099-9843-f73e8c6afefa tempest-VolumesSnapshotTestJSON-1795745985 None] Deleted volume successfully.
Sep 28 18:10:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-46ba5d0c-9909-4099-9843-f73e8c6afefa tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-bd24ecf9-db6a-4814-84d3-fae5429acd9a-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:10:22 devstack sudo[94578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271
Sep 28 18:10:22 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:23 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-39f52f7c-062d-412e-be70-dcf796cdda42 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271" returned: 0 in 0.522s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:23 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-39f52f7c-062d-412e-be70-dcf796cdda42 tempest-VolumesSnapshotTestJSON-1795745985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70396b4a-92e9-4160-aff0-bf31e85eb9af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:10:23 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed281c7-7f14-4878-b2de-f94e78128d0b]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:10:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-39f52f7c-062d-412e-be70-dcf796cdda42 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:23 devstack sudo[94585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af
Sep 28 18:10:23 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:23 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-39f52f7c-062d-412e-be70-dcf796cdda42 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af" returned: 0 in 0.697s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-39f52f7c-062d-412e-be70-dcf796cdda42 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:23 devstack sudo[94590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271
Sep 28 18:10:23 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:24 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-39f52f7c-062d-412e-be70-dcf796cdda42 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271" returned: 0 in 0.444s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-39f52f7c-062d-412e-be70-dcf796cdda42 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:24 devstack sudo[94595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271
Sep 28 18:10:24 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:24 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-39f52f7c-062d-412e-be70-dcf796cdda42 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af.b2ee4cdb-53f5-45e0-82ea-df75d93fb271" returned: 0 in 0.357s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-39f52f7c-062d-412e-be70-dcf796cdda42 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-b2ee4cdb-53f5-45e0-82ea-df75d93fb271" released by "_delete_snapshot" :: held 2.224s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:10:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-39f52f7c-062d-412e-be70-dcf796cdda42 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-70396b4a-92e9-4160-aff0-bf31e85eb9af" released by "delete_snapshot" :: held 2.260s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:10:24 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-39f52f7c-062d-412e-be70-dcf796cdda42 tempest-VolumesSnapshotTestJSON-1795745985 None] Created reservations ['1974957e-5ea8-4de4-89af-07bec18184c8', 'ce4d152b-f09d-490d-81b9-78ea79522fa8', '556017a6-7d11-4312-a431-10404853f5e2', '7bc0b4da-f1ba-4012-bc18-6195a1f35b9a'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:10:24 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-39f52f7c-062d-412e-be70-dcf796cdda42 tempest-VolumesSnapshotTestJSON-1795745985 None] Delete snapshot completed successfully.
Sep 28 18:10:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-39f52f7c-062d-412e-be70-dcf796cdda42 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-b2ee4cdb-53f5-45e0-82ea-df75d93fb271-delete_snapshot" released by "delete_snapshot" :: held 2.497s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:10:25 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-8afeea3b-48d3-460e-82b9-9e77a3480700 tempest-GroupSnapshotsTest-1942732534 None] Group tempest-GroupSnapshotsTest-Group-1010278963: creating
Sep 28 18:10:25 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-8afeea3b-48d3-460e-82b9-9e77a3480700 tempest-GroupSnapshotsTest-1942732534 None] Group tempest-GroupSnapshotsTest-Group-1010278963: created successfully
Sep 28 18:10:25 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-8afeea3b-48d3-460e-82b9-9e77a3480700 tempest-GroupSnapshotsTest-1942732534 None] Create group completed successfully.
Sep 28 18:10:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ffb5358a-9e0c-4f8f-967d-1e0df2e4273e tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-70396b4a-92e9-4160-aff0-bf31e85eb9af-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:10:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ffb5358a-9e0c-4f8f-967d-1e0df2e4273e tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-70396b4a-92e9-4160-aff0-bf31e85eb9af-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:10:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ffb5358a-9e0c-4f8f-967d-1e0df2e4273e tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-quobyte-70396b4a-92e9-4160-aff0-bf31e85eb9af" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:10:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ffb5358a-9e0c-4f8f-967d-1e0df2e4273e tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-70396b4a-92e9-4160-aff0-bf31e85eb9af" acquired by "delete_volume" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:10:25 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[607ff4ac-f5a6-48e3-8674-1b65b3b63d6d]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:10:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ffb5358a-9e0c-4f8f-967d-1e0df2e4273e tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:26 devstack sudo[94598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af
Sep 28 18:10:26 devstack sudo[94598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:26 devstack sudo[94598]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ffb5358a-9e0c-4f8f-967d-1e0df2e4273e tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af" returned: 0 in 0.545s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ffb5358a-9e0c-4f8f-967d-1e0df2e4273e tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:26 devstack sudo[94603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af
Sep 28 18:10:26 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:26 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ffb5358a-9e0c-4f8f-967d-1e0df2e4273e tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-70396b4a-92e9-4160-aff0-bf31e85eb9af" returned: 0 in 0.356s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:26 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ffb5358a-9e0c-4f8f-967d-1e0df2e4273e tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-70396b4a-92e9-4160-aff0-bf31e85eb9af" released by "delete_volume" :: held 1.003s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-ffb5358a-9e0c-4f8f-967d-1e0df2e4273e tempest-VolumesSnapshotTestJSON-1795745985 None] Created reservations ['873d91f8-4673-4b45-9ba7-a6199fab4e86', 'b5b5a1ae-6959-48c5-8e4c-60c076c35991', '2ad7edb6-93ec-4ee0-ba4a-34ac6e985888', '953331a7-f2af-419b-ac47-7d9955242874'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ffb5358a-9e0c-4f8f-967d-1e0df2e4273e tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ffb5358a-9e0c-4f8f-967d-1e0df2e4273e tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ffb5358a-9e0c-4f8f-967d-1e0df2e4273e tempest-VolumesSnapshotTestJSON-1795745985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ffb5358a-9e0c-4f8f-967d-1e0df2e4273e tempest-VolumesSnapshotTestJSON-1795745985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ffb5358a-9e0c-4f8f-967d-1e0df2e4273e tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ffb5358a-9e0c-4f8f-967d-1e0df2e4273e tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:27 devstack sudo[94606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:10:27 devstack sudo[94606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Flow 'volume_create_manager' (21104d14-8360-4f69-9bfd-c0b6e7beda01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aecde259-669a-4dbb-969e-0d797feb3fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aecde259-669a-4dbb-969e-0d797feb3fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-127973545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2050d1f1-fd16-4e40-bb35-8f507749a81c,host='devstack@QuobyteHD#QuobyteHD',id=2159e864-edae-47eb-bbfa-c869e38d36a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e238fc908754b82be926348f117bde0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:27Z,use_quota=True,user_id='0063385e2ba347ccabc824cbb41c1d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(063b494b-512a-460b-afa0-bd6664822ae5),volume_type_id=063b494b-512a-460b-afa0-bd6664822ae5)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5b5f27-ccb5-4a46-b919-cd2846a69a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5b5f27-ccb5-4a46-b919-cd2846a69a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce7a8db-5b77-4774-a004-0083059af587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce7a8db-5b77-4774-a004-0083059af587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2159e864-edae-47eb-bbfa-c869e38d36a1', 'volume_name': 'volume-2159e864-edae-47eb-bbfa-c869e38d36a1', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bafbc556-8ce8-4ca3-8042-a2dc277f6765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bafbc556-8ce8-4ca3-8042-a2dc277f6765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5bc123-d393-417b-a6ea-3fb272f49168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:27 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Volume 2159e864-edae-47eb-bbfa-c869e38d36a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2159e864-edae-47eb-bbfa-c869e38d36a1', 'volume_size': 1}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2050d1f1-fd16-4e40-bb35-8f507749a81c,created_at=2026-09-28T16:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-127973545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2050d1f1-fd16-4e40-bb35-8f507749a81c,host='devstack@QuobyteHD#QuobyteHD',id=2159e864-edae-47eb-bbfa-c869e38d36a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e238fc908754b82be926348f117bde0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:27Z,use_quota=True,user_id='0063385e2ba347ccabc824cbb41c1d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(063b494b-512a-460b-afa0-bd6664822ae5),volume_type_id=063b494b-512a-460b-afa0-bd6664822ae5)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Creating volume 2159e864-edae-47eb-bbfa-c869e38d36a1 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:10:27 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:27 devstack sudo[94608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1 1073741824
Sep 28 18:10:27 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:27 devstack sudo[94606]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ffb5358a-9e0c-4f8f-967d-1e0df2e4273e tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.626s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-ffb5358a-9e0c-4f8f-967d-1e0df2e4273e tempest-VolumesSnapshotTestJSON-1795745985 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:10:27 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-ffb5358a-9e0c-4f8f-967d-1e0df2e4273e tempest-VolumesSnapshotTestJSON-1795745985 None] Deleted volume successfully.
Sep 28 18:10:27 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ffb5358a-9e0c-4f8f-967d-1e0df2e4273e tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-70396b4a-92e9-4160-aff0-bf31e85eb9af-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:10:28 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1 1073741824" returned: 0 in 0.702s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:28 devstack sudo[94616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1
Sep 28 18:10:28 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:28 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1" returned: 0 in 0.469s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:28 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:10:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5bc123-d393-417b-a6ea-3fb272f49168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2159e864-edae-47eb-bbfa-c869e38d36a1', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab28b414-37e5-4c06-a688-f6b54d487f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:28 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Volume volume-2159e864-edae-47eb-bbfa-c869e38d36a1 (2159e864-edae-47eb-bbfa-c869e38d36a1): created successfully
Sep 28 18:10:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab28b414-37e5-4c06-a688-f6b54d487f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Flow 'volume_create_manager' (21104d14-8360-4f69-9bfd-c0b6e7beda01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:10:28 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-7594b5d1-8635-466f-bfdf-c1ac45c5189d tempest-GroupSnapshotsTest-1942732534 None] Created volume successfully.
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Flow 'volume_create_manager' (0bc31575-8dcc-462e-9695-a12239c7f802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9be6485d-aa93-4d94-ba08-1c6819b248c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9be6485d-aa93-4d94-ba08-1c6819b248c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-720905342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5206241-a925-4272-b1ae-47bc6a3a07ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb286279ad05458b8a6745411d252e69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:29Z,use_quota=True,user_id='2116c58e4be6429ea7b907aa247d3b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832e79cf-7c6d-462b-a4fc-221f3690db11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832e79cf-7c6d-462b-a4fc-221f3690db11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08999fb3-50fc-438c-85c4-524cbf3ead48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08999fb3-50fc-438c-85c4-524cbf3ead48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5206241-a925-4272-b1ae-47bc6a3a07ef', 'volume_name': 'volume-c5206241-a925-4272-b1ae-47bc6a3a07ef', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98ba21fc-5ac0-439a-8367-2c157bc581c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98ba21fc-5ac0-439a-8367-2c157bc581c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546743d9-940e-4478-9510-904310fb9b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:29 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Volume c5206241-a925-4272-b1ae-47bc6a3a07ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5206241-a925-4272-b1ae-47bc6a3a07ef', 'volume_size': 1}
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-720905342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5206241-a925-4272-b1ae-47bc6a3a07ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb286279ad05458b8a6745411d252e69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:29Z,use_quota=True,user_id='2116c58e4be6429ea7b907aa247d3b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Creating volume c5206241-a925-4272-b1ae-47bc6a3a07ef {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:10:29 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:29 devstack sudo[94619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef 1073741824
Sep 28 18:10:29 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:29 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef 1073741824" returned: 0 in 0.663s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:30 devstack sudo[94627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef
Sep 28 18:10:30 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:30 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef" returned: 0 in 0.647s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:10:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546743d9-940e-4478-9510-904310fb9b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5206241-a925-4272-b1ae-47bc6a3a07ef', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1113a85-57d2-4c0f-a040-3a4fc4bec352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:30 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Volume volume-c5206241-a925-4272-b1ae-47bc6a3a07ef (c5206241-a925-4272-b1ae-47bc6a3a07ef): created successfully
Sep 28 18:10:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1113a85-57d2-4c0f-a040-3a4fc4bec352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Flow 'volume_create_manager' (0bc31575-8dcc-462e-9695-a12239c7f802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:10:30 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-159d7cd0-d656-4b89-a762-896bd025da94 tempest-VolumesSnapshotTestJSON-1795745985 None] Created volume successfully.
Sep 28 18:10:31 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-0d92ac64-032b-440e-9738-b65f6444d9a4 tempest-GroupSnapshotsTest-1942732534 None] GroupSnapshot 6082a505-4fc6-4a11-bdd3-037c0ee7c41a: creating.
Sep 28 18:10:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d92ac64-032b-440e-9738-b65f6444d9a4 tempest-GroupSnapshotsTest-1942732534 None] Group snapshot 6082a505-4fc6-4a11-bdd3-037c0ee7c41a: creating. {{(pid=87046) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 28 18:10:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0d92ac64-032b-440e-9738-b65f6444d9a4 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0d92ac64-032b-440e-9738-b65f6444d9a4 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:31 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-0d92ac64-032b-440e-9738-b65f6444d9a4 tempest-GroupSnapshotsTest-1942732534 None] Creating offline snapshot 0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f of volume 2159e864-edae-47eb-bbfa-c869e38d36a1 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:10:31 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[35205378-22da-48d6-8a86-8a4574d6facb]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:10:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d92ac64-032b-440e-9738-b65f6444d9a4 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:31 devstack sudo[94654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1
Sep 28 18:10:31 devstack sudo[94654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8fa1fc9c-64b0-4d82-8fe1-78217cac85e1 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:31 devstack sudo[94654]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d92ac64-032b-440e-9738-b65f6444d9a4 tempest-GroupSnapshotsTest-1942732534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1" returned: 0 in 0.695s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d92ac64-032b-440e-9738-b65f6444d9a4 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:32 devstack sudo[94661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f 1G
Sep 28 18:10:32 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:32 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d92ac64-032b-440e-9738-b65f6444d9a4 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f 1G" returned: 0 in 0.789s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d92ac64-032b-440e-9738-b65f6444d9a4 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2159e864-edae-47eb-bbfa-c869e38d36a1 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:32 devstack sudo[94670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2159e864-edae-47eb-bbfa-c869e38d36a1 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f
Sep 28 18:10:32 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:33 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d92ac64-032b-440e-9738-b65f6444d9a4 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2159e864-edae-47eb-bbfa-c869e38d36a1 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f" returned: 0 in 0.437s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:33 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-0d92ac64-032b-440e-9738-b65f6444d9a4 tempest-GroupSnapshotsTest-1942732534 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f is being set with open permissions: ugo+rw: NotImplementedError
Sep 28 18:10:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d92ac64-032b-440e-9738-b65f6444d9a4 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:33 devstack sudo[94678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f
Sep 28 18:10:33 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:33 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d92ac64-032b-440e-9738-b65f6444d9a4 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f" returned: 0 in 0.374s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d92ac64-032b-440e-9738-b65f6444d9a4 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:33 devstack sudo[94681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.info
Sep 28 18:10:33 devstack sudo[94681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:33 devstack sudo[94681]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d92ac64-032b-440e-9738-b65f6444d9a4 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.info" returned: 0 in 0.362s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:33 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-0d92ac64-032b-440e-9738-b65f6444d9a4 tempest-GroupSnapshotsTest-1942732534 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 28 18:10:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d92ac64-032b-440e-9738-b65f6444d9a4 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:34 devstack sudo[94684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.info
Sep 28 18:10:34 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:34 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d92ac64-032b-440e-9738-b65f6444d9a4 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.info" returned: 0 in 0.297s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0d92ac64-032b-440e-9738-b65f6444d9a4 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.121s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8fa1fc9c-64b0-4d82-8fe1-78217cac85e1 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.532s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:34 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-8fa1fc9c-64b0-4d82-8fe1-78217cac85e1 tempest-VolumesSnapshotTestJSON-1795745985 None] Creating offline snapshot cd18516c-6d9c-4569-bee9-ab36f4489ec2 of volume c5206241-a925-4272-b1ae-47bc6a3a07ef {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:10:34 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f7bafd-eda3-4ebe-9b46-f3ace894d06c]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:10:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8fa1fc9c-64b0-4d82-8fe1-78217cac85e1 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:34 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-0d92ac64-032b-440e-9738-b65f6444d9a4 tempest-GroupSnapshotsTest-1942732534 None] group_snapshot 6082a505-4fc6-4a11-bdd3-037c0ee7c41a: created successfully
Sep 28 18:10:34 devstack sudo[94687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef
Sep 28 18:10:34 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:34 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8fa1fc9c-64b0-4d82-8fe1-78217cac85e1 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef" returned: 0 in 0.545s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8fa1fc9c-64b0-4d82-8fe1-78217cac85e1 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:35 devstack sudo[94692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2 1G
Sep 28 18:10:35 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:35 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8fa1fc9c-64b0-4d82-8fe1-78217cac85e1 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2 1G" returned: 0 in 0.752s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8fa1fc9c-64b0-4d82-8fe1-78217cac85e1 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5206241-a925-4272-b1ae-47bc6a3a07ef -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:35 devstack sudo[94697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5206241-a925-4272-b1ae-47bc6a3a07ef -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2
Sep 28 18:10:35 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:36 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8fa1fc9c-64b0-4d82-8fe1-78217cac85e1 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5206241-a925-4272-b1ae-47bc6a3a07ef -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2" returned: 0 in 0.500s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:36 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-8fa1fc9c-64b0-4d82-8fe1-78217cac85e1 tempest-VolumesSnapshotTestJSON-1795745985 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2 is being set with open permissions: ugo+rw
Sep 28 18:10:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8fa1fc9c-64b0-4d82-8fe1-78217cac85e1 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:36 devstack sudo[94702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2
Sep 28 18:10:36 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:36 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8fa1fc9c-64b0-4d82-8fe1-78217cac85e1 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2" returned: 0 in 0.534s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8fa1fc9c-64b0-4d82-8fe1-78217cac85e1 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:36 devstack sudo[94705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.info
Sep 28 18:10:36 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:37 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8fa1fc9c-64b0-4d82-8fe1-78217cac85e1 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.info" returned: 0 in 0.474s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:37 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-8fa1fc9c-64b0-4d82-8fe1-78217cac85e1 tempest-VolumesSnapshotTestJSON-1795745985 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.info is being set with open permissions: ugo+rw
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8fa1fc9c-64b0-4d82-8fe1-78217cac85e1 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:37 devstack sudo[94708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.info
Sep 28 18:10:37 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:37 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8fa1fc9c-64b0-4d82-8fe1-78217cac85e1 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.info" returned: 0 in 0.325s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8fa1fc9c-64b0-4d82-8fe1-78217cac85e1 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.395s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.800s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "cinder-quobyte-0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f-2cc19826-606f-444e-bdf2-7f29324afc15" by "_create_volume_from_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f-2cc19826-606f-444e-bdf2-7f29324afc15" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Creating volume 2cc19826-606f-444e-bdf2-7f29324afc15 from snapshot 0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f {{(pid=87046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "cinder-quobyte-2cc19826-606f-444e-bdf2-7f29324afc15" by "_copy_volume_from_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:10:37 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-8fa1fc9c-64b0-4d82-8fe1-78217cac85e1 tempest-VolumesSnapshotTestJSON-1795745985 None] Create snapshot completed successfully
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-2cc19826-606f-444e-bdf2-7f29324afc15" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] snapshot: 0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f, volume: 2cc19826-606f-444e-bdf2-7f29324afc15,  {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca90865-8c7e-4307-97c1-08e21323a6a0]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:10:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:38 devstack sudo[94711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f
Sep 28 18:10:38 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:38 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f" returned: 0 in 0.739s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:38 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2159e864-edae-47eb-bbfa-c869e38d36a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:10:38 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1085ad82-0a63-435c-aed6-c39b5e7f4fa8]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:10:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:38 devstack sudo[94716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1
Sep 28 18:10:38 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:39 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1" returned: 0 in 0.710s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1 {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Creating direct copy from snapshot {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG cinder.utils [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Path /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cc19826-606f-444e-bdf2-7f29324afc15 not found in is_blk_device check {{(pid=87046) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cc19826-606f-444e-bdf2-7f29324afc15 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:39 devstack sudo[94722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:10:39 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:39 devstack sudo[94723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cc19826-606f-444e-bdf2-7f29324afc15
Sep 28 18:10:39 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Flow 'volume_create_manager' (a51d22e5-b051-40aa-bd6e-8c58b27569c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7c837ae-39d6-4b81-b9e5-6eff656df5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7c837ae-39d6-4b81-b9e5-6eff656df5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-388839033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48543c4c-6ce2-4cf6-afe2-74702d9785b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb286279ad05458b8a6745411d252e69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cd18516c-6d9c-4569-bee9-ab36f4489ec2,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:39Z,use_quota=True,user_id='2116c58e4be6429ea7b907aa247d3b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbc5138-f349-4858-8e17-02ffc8b3898f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbc5138-f349-4858-8e17-02ffc8b3898f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd2daa0-96a5-4270-9449-48cbfa54ba24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd2daa0-96a5-4270-9449-48cbfa54ba24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '48543c4c-6ce2-4cf6-afe2-74702d9785b7', 'volume_name': 'volume-48543c4c-6ce2-4cf6-afe2-74702d9785b7', 'volume_size': 1, 'snapshot_id': 'cd18516c-6d9c-4569-bee9-ab36f4489ec2'}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49143b4d-5c7e-430d-b790-729e113d6318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49143b4d-5c7e-430d-b790-729e113d6318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56bd3ae5-095b-4e94-a950-642cbf5f8d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:10:39 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Volume 48543c4c-6ce2-4cf6-afe2-74702d9785b7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-48543c4c-6ce2-4cf6-afe2-74702d9785b7', 'volume_size': 1, 'snapshot_id': 'cd18516c-6d9c-4569-bee9-ab36f4489ec2'}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:39 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.564s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:10:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:10:49 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cc19826-606f-444e-bdf2-7f29324afc15" returned: 0 in 9.816s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Image conversion details: src /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1, size 1024.00 MB, duration 9.82 sec, destination /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cc19826-606f-444e-bdf2-7f29324afc15 {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:10:49 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Converted 1024.00 MB image at 104.31 MB/s
Sep 28 18:10:49 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cc19826-606f-444e-bdf2-7f29324afc15 is being set with open permissions: ugo+rw: NotImplementedError
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cc19826-606f-444e-bdf2-7f29324afc15 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:49 devstack sudo[94761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cc19826-606f-444e-bdf2-7f29324afc15
Sep 28 18:10:49 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:49 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cc19826-606f-444e-bdf2-7f29324afc15" returned: 0 in 0.311s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-2cc19826-606f-444e-bdf2-7f29324afc15" released by "_copy_volume_from_snapshot" :: held 11.717s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f-2cc19826-606f-444e-bdf2-7f29324afc15" released by "_create_volume_from_snapshot" :: held 11.830s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.872s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.801s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-quobyte-cd18516c-6d9c-4569-bee9-ab36f4489ec2-48543c4c-6ce2-4cf6-afe2-74702d9785b7" by "_create_volume_from_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-cd18516c-6d9c-4569-bee9-ab36f4489ec2-48543c4c-6ce2-4cf6-afe2-74702d9785b7" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Creating volume 48543c4c-6ce2-4cf6-afe2-74702d9785b7 from snapshot cd18516c-6d9c-4569-bee9-ab36f4489ec2 {{(pid=87046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-quobyte-48543c4c-6ce2-4cf6-afe2-74702d9785b7" by "_copy_volume_from_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-48543c4c-6ce2-4cf6-afe2-74702d9785b7" acquired by "_copy_volume_from_snapshot" :: waited 0.071s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] snapshot: cd18516c-6d9c-4569-bee9-ab36f4489ec2, volume: 48543c4c-6ce2-4cf6-afe2-74702d9785b7,  {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea35778e-e77e-4aa1-88e2-374ac859d5ce]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:10:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:49 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-f6317fc3-191b-4c9f-8e11-ada217e732b6 tempest-GroupSnapshotsTest-1942732534 None] Create group from source-snapshot-6082a505-4fc6-4a11-bdd3-037c0ee7c41a completed successfully.
Sep 28 18:10:49 devstack sudo[94765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2
Sep 28 18:10:49 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:50 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2" returned: 0 in 0.610s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5206241-a925-4272-b1ae-47bc6a3a07ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:10:50 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2b49d2-9654-4895-8c7a-fbf64431c44b]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:10:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:50 devstack sudo[94770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef
Sep 28 18:10:50 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:51 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef" returned: 0 in 0.988s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 28 18:10:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Creating direct copy from snapshot {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 28 18:10:51 devstack cinder-volume[87046]: DEBUG cinder.utils [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Path /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-48543c4c-6ce2-4cf6-afe2-74702d9785b7 not found in is_blk_device check {{(pid=87046) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 28 18:10:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-48543c4c-6ce2-4cf6-afe2-74702d9785b7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:51 devstack sudo[94818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-48543c4c-6ce2-4cf6-afe2-74702d9785b7
Sep 28 18:10:51 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-06435ed7-6dae-424d-a7e3-a38274b1116f tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "cinder-quobyte-2cc19826-606f-444e-bdf2-7f29324afc15" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:10:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-06435ed7-6dae-424d-a7e3-a38274b1116f tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-2cc19826-606f-444e-bdf2-7f29324afc15" acquired by "delete_volume" :: waited 0.031s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:10:51 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fba3d70-8a4b-4d39-b33e-c802a1c97465]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:10:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-06435ed7-6dae-424d-a7e3-a38274b1116f tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cc19826-606f-444e-bdf2-7f29324afc15 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:52 devstack sudo[94830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cc19826-606f-444e-bdf2-7f29324afc15
Sep 28 18:10:52 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:52 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-06435ed7-6dae-424d-a7e3-a38274b1116f tempest-GroupSnapshotsTest-1942732534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cc19826-606f-444e-bdf2-7f29324afc15" returned: 0 in 1.049s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-06435ed7-6dae-424d-a7e3-a38274b1116f tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cc19826-606f-444e-bdf2-7f29324afc15 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:52 devstack sudo[94865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cc19826-606f-444e-bdf2-7f29324afc15
Sep 28 18:10:52 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:53 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-598fde9a-dcd8-4959-8169-3d61472fbf89 tempest-GroupsV320Test-1291580122 None] Group tempest-GroupsV320Test-Group-589514187: creating
Sep 28 18:10:53 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-598fde9a-dcd8-4959-8169-3d61472fbf89 tempest-GroupsV320Test-1291580122 None] Group tempest-GroupsV320Test-Group-589514187: created successfully
Sep 28 18:10:53 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-598fde9a-dcd8-4959-8169-3d61472fbf89 tempest-GroupsV320Test-1291580122 None] Create group completed successfully.
Sep 28 18:10:53 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-06435ed7-6dae-424d-a7e3-a38274b1116f tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cc19826-606f-444e-bdf2-7f29324afc15" returned: 0 in 0.894s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:53 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-06435ed7-6dae-424d-a7e3-a38274b1116f tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-2cc19826-606f-444e-bdf2-7f29324afc15" released by "delete_volume" :: held 2.085s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:10:54 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-06435ed7-6dae-424d-a7e3-a38274b1116f tempest-GroupSnapshotsTest-1942732534 None] Created reservations ['c680f945-6779-4098-b3a4-efd9b69febb0'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:10:54 devstack cinder-volume[87046]: WARNING cinder.quota [None req-06435ed7-6dae-424d-a7e3-a38274b1116f tempest-GroupSnapshotsTest-1942732534 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1648960620 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1648960620, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:10:54 devstack cinder-volume[87046]: WARNING cinder.quota [None req-06435ed7-6dae-424d-a7e3-a38274b1116f tempest-GroupSnapshotsTest-1942732534 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1648960620 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1648960620, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:10:54 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-06435ed7-6dae-424d-a7e3-a38274b1116f tempest-GroupSnapshotsTest-1942732534 None] Created reservations ['9da4d568-6eed-4b41-8085-06bff892f883', '6091973f-68c7-407f-9c3e-91030b73e62c', '8a8f4a1d-7f2d-40a3-b22e-e33b4ff0d2b8', '68511471-ac59-4a15-a184-1a135b8a2ca8'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:10:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-06435ed7-6dae-424d-a7e3-a38274b1116f tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-06435ed7-6dae-424d-a7e3-a38274b1116f tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:54 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-06435ed7-6dae-424d-a7e3-a38274b1116f tempest-GroupSnapshotsTest-1942732534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:10:54 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-06435ed7-6dae-424d-a7e3-a38274b1116f tempest-GroupSnapshotsTest-1942732534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:10:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-06435ed7-6dae-424d-a7e3-a38274b1116f tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-06435ed7-6dae-424d-a7e3-a38274b1116f tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:54 devstack sudo[94879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:10:54 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:55 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-06435ed7-6dae-424d-a7e3-a38274b1116f tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.795s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:55 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-06435ed7-6dae-424d-a7e3-a38274b1116f tempest-GroupSnapshotsTest-1942732534 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:10:55 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-06435ed7-6dae-424d-a7e3-a38274b1116f tempest-GroupSnapshotsTest-1942732534 None] Delete group completed successfully.
Sep 28 18:10:55 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-5783ce76-cf6c-4d9d-8acf-f2fb46a2325c tempest-GroupsV320Test-1291580122 None] Created reservations ['e574426b-be9d-425b-9f00-5c0f7c3abcc9'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:10:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5783ce76-cf6c-4d9d-8acf-f2fb46a2325c tempest-GroupsV320Test-1291580122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:10:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5783ce76-cf6c-4d9d-8acf-f2fb46a2325c tempest-GroupsV320Test-1291580122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:10:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5783ce76-cf6c-4d9d-8acf-f2fb46a2325c tempest-GroupsV320Test-1291580122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:10:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5783ce76-cf6c-4d9d-8acf-f2fb46a2325c tempest-GroupsV320Test-1291580122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:10:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5783ce76-cf6c-4d9d-8acf-f2fb46a2325c tempest-GroupsV320Test-1291580122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:10:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5783ce76-cf6c-4d9d-8acf-f2fb46a2325c tempest-GroupsV320Test-1291580122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:56 devstack sudo[94884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:10:56 devstack sudo[94884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:56 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-636dac67-10a9-4f29-b379-179fbd5f8189 tempest-GroupSnapshotsTest-1942732534 None] group_snapshot 6082a505-4fc6-4a11-bdd3-037c0ee7c41a: deleting
Sep 28 18:10:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-636dac67-10a9-4f29-b379-179fbd5f8189 tempest-GroupSnapshotsTest-1942732534 None] group_snapshot 6082a505-4fc6-4a11-bdd3-037c0ee7c41a: deleting {{(pid=87046) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 28 18:10:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-636dac67-10a9-4f29-b379-179fbd5f8189 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "cinder-quobyte-2159e864-edae-47eb-bbfa-c869e38d36a1" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:10:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-636dac67-10a9-4f29-b379-179fbd5f8189 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-2159e864-edae-47eb-bbfa-c869e38d36a1" acquired by "delete_snapshot" :: waited 0.081s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:10:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-636dac67-10a9-4f29-b379-179fbd5f8189 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "cinder-quobyte-0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:10:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-636dac67-10a9-4f29-b379-179fbd5f8189 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f" acquired by "_delete_snapshot" :: waited 0.075s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:10:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-636dac67-10a9-4f29-b379-179fbd5f8189 tempest-GroupSnapshotsTest-1942732534 None] Deleting offline snapshot 0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f of volume 2159e864-edae-47eb-bbfa-c869e38d36a1 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:10:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-636dac67-10a9-4f29-b379-179fbd5f8189 tempest-GroupSnapshotsTest-1942732534 None] snapshot_file for this snap is: volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:10:56 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f598c2fb-9de8-413c-9bd3-5a12fbe2a2a6]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:10:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-636dac67-10a9-4f29-b379-179fbd5f8189 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:56 devstack sudo[94884]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5783ce76-cf6c-4d9d-8acf-f2fb46a2325c tempest-GroupsV320Test-1291580122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.818s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:56 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-5783ce76-cf6c-4d9d-8acf-f2fb46a2325c tempest-GroupsV320Test-1291580122 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:10:56 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-5783ce76-cf6c-4d9d-8acf-f2fb46a2325c tempest-GroupsV320Test-1291580122 None] Delete group completed successfully.
Sep 28 18:10:57 devstack sudo[94887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f
Sep 28 18:10:57 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:10:58 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root
Sep 28 18:10:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-636dac67-10a9-4f29-b379-179fbd5f8189 tempest-GroupSnapshotsTest-1942732534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f" returned: 0 in 1.851s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:10:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-636dac67-10a9-4f29-b379-179fbd5f8189 tempest-GroupSnapshotsTest-1942732534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2159e864-edae-47eb-bbfa-c869e38d36a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:10:58 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea5c316-b60c-4b7f-832f-9fecc3dd0896]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:10:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-636dac67-10a9-4f29-b379-179fbd5f8189 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:10:59 devstack sudo[94894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1
Sep 28 18:10:59 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:01 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-636dac67-10a9-4f29-b379-179fbd5f8189 tempest-GroupSnapshotsTest-1942732534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1" returned: 0 in 2.467s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-636dac67-10a9-4f29-b379-179fbd5f8189 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:01 devstack sudo[94914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f
Sep 28 18:11:01 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:02 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-636dac67-10a9-4f29-b379-179fbd5f8189 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f" returned: 0 in 1.610s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-636dac67-10a9-4f29-b379-179fbd5f8189 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:02 devstack sudo[94921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f
Sep 28 18:11:02 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:04 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-636dac67-10a9-4f29-b379-179fbd5f8189 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1.0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f" returned: 0 in 1.492s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-636dac67-10a9-4f29-b379-179fbd5f8189 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-0e8e4b70-5a05-4a81-8c7c-dda40c5dab3f" released by "_delete_snapshot" :: held 7.967s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-636dac67-10a9-4f29-b379-179fbd5f8189 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-2159e864-edae-47eb-bbfa-c869e38d36a1" released by "delete_snapshot" :: held 8.087s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:04 devstack cinder-volume[87046]: WARNING cinder.quota [None req-636dac67-10a9-4f29-b379-179fbd5f8189 tempest-GroupSnapshotsTest-1942732534 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1648960620 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1648960620, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:11:04 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-636dac67-10a9-4f29-b379-179fbd5f8189 tempest-GroupSnapshotsTest-1942732534 None] Created reservations ['bccd0fb7-02ee-4caf-92b1-006082d92f22', 'cd19c5f9-fd4d-43c8-9ec9-928a54ba4ebe', '4f6bf0fe-f756-445e-b6e5-cab58694b66f', '7ca3d373-6843-4344-abfd-b8df0b8a94ac'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:11:05 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-636dac67-10a9-4f29-b379-179fbd5f8189 tempest-GroupSnapshotsTest-1942732534 None] group_snapshot 6082a505-4fc6-4a11-bdd3-037c0ee7c41a: deleted successfully
Sep 28 18:11:06 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-73cd340b-3ab8-47c6-a606-1d48195dc37e tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "cinder-quobyte-2159e864-edae-47eb-bbfa-c869e38d36a1" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:06 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-73cd340b-3ab8-47c6-a606-1d48195dc37e tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-2159e864-edae-47eb-bbfa-c869e38d36a1" acquired by "delete_volume" :: waited 0.039s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:06 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1441ae21-b8ac-4d5b-87ee-e4d3eadb9882]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-73cd340b-3ab8-47c6-a606-1d48195dc37e tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-48543c4c-6ce2-4cf6-afe2-74702d9785b7" returned: 0 in 15.310s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:06 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Image conversion details: src /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef, size 1024.00 MB, duration 15.32 sec, destination /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-48543c4c-6ce2-4cf6-afe2-74702d9785b7 {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:11:06 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Converted 1024.00 MB image at 66.85 MB/s
Sep 28 18:11:06 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-48543c4c-6ce2-4cf6-afe2-74702d9785b7 is being set with open permissions: ugo+rw
Sep 28 18:11:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-48543c4c-6ce2-4cf6-afe2-74702d9785b7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:06 devstack sudo[94925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1
Sep 28 18:11:06 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:06 devstack sudo[94926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-48543c4c-6ce2-4cf6-afe2-74702d9785b7
Sep 28 18:11:06 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:07 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-48543c4c-6ce2-4cf6-afe2-74702d9785b7" returned: 0 in 0.433s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-48543c4c-6ce2-4cf6-afe2-74702d9785b7" released by "_copy_volume_from_snapshot" :: held 17.546s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-cd18516c-6d9c-4569-bee9-ab36f4489ec2-48543c4c-6ce2-4cf6-afe2-74702d9785b7" released by "_create_volume_from_snapshot" :: held 17.730s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 17.765s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:07 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56bd3ae5-095b-4e94-a950-642cbf5f8d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48543c4c-6ce2-4cf6-afe2-74702d9785b7', 'volume_size': 1, 'snapshot_id': 'cd18516c-6d9c-4569-bee9-ab36f4489ec2'}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8259dfe8-326f-41a1-9c03-1d1f4f1ea23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-73cd340b-3ab8-47c6-a606-1d48195dc37e tempest-GroupSnapshotsTest-1942732534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1" returned: 0 in 1.004s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-73cd340b-3ab8-47c6-a606-1d48195dc37e tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:07 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Volume volume-48543c4c-6ce2-4cf6-afe2-74702d9785b7 (48543c4c-6ce2-4cf6-afe2-74702d9785b7): created successfully
Sep 28 18:11:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8259dfe8-326f-41a1-9c03-1d1f4f1ea23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Flow 'volume_create_manager' (a51d22e5-b051-40aa-bd6e-8c58b27569c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:11:07 devstack sudo[94934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1
Sep 28 18:11:07 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:07 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-52683b97-9d79-4f1b-97d5-f2472e6da178 tempest-VolumesSnapshotTestJSON-1795745985 None] Created volume successfully.
Sep 28 18:11:07 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-73cd340b-3ab8-47c6-a606-1d48195dc37e tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2159e864-edae-47eb-bbfa-c869e38d36a1" returned: 0 in 0.422s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-73cd340b-3ab8-47c6-a606-1d48195dc37e tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-2159e864-edae-47eb-bbfa-c869e38d36a1" released by "delete_volume" :: held 1.633s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:07 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-73cd340b-3ab8-47c6-a606-1d48195dc37e tempest-GroupSnapshotsTest-1942732534 None] Created reservations ['0e04d15b-ccbd-4062-9435-08aa2c8b3803'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:11:08 devstack cinder-volume[87046]: WARNING cinder.db.api [None req-73cd340b-3ab8-47c6-a606-1d48195dc37e tempest-GroupSnapshotsTest-1942732534 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1648960620']
Sep 28 18:11:08 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-73cd340b-3ab8-47c6-a606-1d48195dc37e tempest-GroupSnapshotsTest-1942732534 None] Created reservations ['83d88a8b-1a71-4a7c-a2ca-cc4b9ed12ffc', '15163812-bb95-4487-a649-bbc6a621dcf2', '785466b7-3383-4ffb-9b55-1a21ba2a5d9a', 'eb33a7d9-136a-4421-b753-82ea434031c4'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:11:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-73cd340b-3ab8-47c6-a606-1d48195dc37e tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-73cd340b-3ab8-47c6-a606-1d48195dc37e tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-73cd340b-3ab8-47c6-a606-1d48195dc37e tempest-GroupSnapshotsTest-1942732534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:11:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-73cd340b-3ab8-47c6-a606-1d48195dc37e tempest-GroupSnapshotsTest-1942732534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:11:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-73cd340b-3ab8-47c6-a606-1d48195dc37e tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-73cd340b-3ab8-47c6-a606-1d48195dc37e tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:08 devstack sudo[94937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:11:08 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-92def6aa-e732-42a9-99ba-f5a93396e180 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-48543c4c-6ce2-4cf6-afe2-74702d9785b7-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-92def6aa-e732-42a9-99ba-f5a93396e180 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-48543c4c-6ce2-4cf6-afe2-74702d9785b7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-92def6aa-e732-42a9-99ba-f5a93396e180 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-quobyte-48543c4c-6ce2-4cf6-afe2-74702d9785b7" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-92def6aa-e732-42a9-99ba-f5a93396e180 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-48543c4c-6ce2-4cf6-afe2-74702d9785b7" acquired by "delete_volume" :: waited 0.016s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:08 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e975737-74b9-4dd1-99c7-17413543a0ca]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-92def6aa-e732-42a9-99ba-f5a93396e180 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-48543c4c-6ce2-4cf6-afe2-74702d9785b7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:08 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-73cd340b-3ab8-47c6-a606-1d48195dc37e tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.446s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:08 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-73cd340b-3ab8-47c6-a606-1d48195dc37e tempest-GroupSnapshotsTest-1942732534 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:11:08 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-73cd340b-3ab8-47c6-a606-1d48195dc37e tempest-GroupSnapshotsTest-1942732534 None] Delete group completed successfully.
Sep 28 18:11:08 devstack sudo[94940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-48543c4c-6ce2-4cf6-afe2-74702d9785b7
Sep 28 18:11:08 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:09 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-92def6aa-e732-42a9-99ba-f5a93396e180 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-48543c4c-6ce2-4cf6-afe2-74702d9785b7" returned: 0 in 0.453s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-92def6aa-e732-42a9-99ba-f5a93396e180 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-48543c4c-6ce2-4cf6-afe2-74702d9785b7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:09 devstack sudo[94946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-48543c4c-6ce2-4cf6-afe2-74702d9785b7
Sep 28 18:11:09 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:09 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-92def6aa-e732-42a9-99ba-f5a93396e180 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-48543c4c-6ce2-4cf6-afe2-74702d9785b7" returned: 0 in 0.484s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-92def6aa-e732-42a9-99ba-f5a93396e180 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-48543c4c-6ce2-4cf6-afe2-74702d9785b7" released by "delete_volume" :: held 1.024s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:09 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-92def6aa-e732-42a9-99ba-f5a93396e180 tempest-VolumesSnapshotTestJSON-1795745985 None] Created reservations ['371e9170-a64a-4e73-8e56-57027f96b7e0', 'b0f89fd5-1669-4ac4-bd30-b6a2e52780ff', '36fbbfb8-e6a5-4ce9-9627-6da5b5d76765', '2cbd50a3-ace9-4417-b2f3-97e71d32c3df'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:11:09 devstack cinder-volume[87046]: DEBUG oslo_db.api [None req-92def6aa-e732-42a9-99ba-f5a93396e180 tempest-VolumesSnapshotTestJSON-1795745985 None] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction')
Sep 28 18:11:09 devstack cinder-volume[87046]: [SQL: SELECT reservations.id AS reservations_id, reservations.uuid AS reservations_uuid, reservations.usage_id AS reservations_usage_id, reservations.project_id AS reservations_project_id, reservations.resource AS reservations_resource, reservations.delta AS reservations_delta, reservations.expire AS reservations_expire, reservations.deleted_at AS reservations_deleted_at, reservations.deleted AS reservations_deleted, reservations.created_at AS reservations_created_at, reservations.updated_at AS reservations_updated_at
Sep 28 18:11:09 devstack cinder-volume[87046]: FROM reservations
Sep 28 18:11:09 devstack cinder-volume[87046]: WHERE reservations.deleted = false AND reservations.uuid IN (%(uuid_1_1)s, %(uuid_1_2)s, %(uuid_1_3)s, %(uuid_1_4)s) FOR UPDATE]
Sep 28 18:11:09 devstack cinder-volume[87046]: [parameters: {'uuid_1_1': '371e9170-a64a-4e73-8e56-57027f96b7e0', 'uuid_1_2': 'b0f89fd5-1669-4ac4-bd30-b6a2e52780ff', 'uuid_1_3': '36fbbfb8-e6a5-4ce9-9627-6da5b5d76765', 'uuid_1_4': '2cbd50a3-ace9-4417-b2f3-97e71d32c3df'}]
Sep 28 18:11:09 devstack cinder-volume[87046]: (Background on this error at: https://sqlalche.me/e/20/e3q8) {{(pid=87046) _is_exception_expected /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:184}}
Sep 28 18:11:09 devstack cinder-volume[87046]: DEBUG oslo_db.api [None req-92def6aa-e732-42a9-99ba-f5a93396e180 tempest-VolumesSnapshotTestJSON-1795745985 None] Performing DB retry for function cinder.db.api.reservation_commit {{(pid=87046) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:155}}
Sep 28 18:11:10 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-3961444a-b5fd-4bdc-b0c5-805fab7a57e0 tempest-GroupSnapshotsTest-1942732534 None] Group tempest-GroupSnapshotsTest-Group-1536972348: creating
Sep 28 18:11:10 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-3961444a-b5fd-4bdc-b0c5-805fab7a57e0 tempest-GroupSnapshotsTest-1942732534 None] Group tempest-GroupSnapshotsTest-Group-1536972348: created successfully
Sep 28 18:11:10 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-3961444a-b5fd-4bdc-b0c5-805fab7a57e0 tempest-GroupSnapshotsTest-1942732534 None] Create group completed successfully.
Sep 28 18:11:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-92def6aa-e732-42a9-99ba-f5a93396e180 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-92def6aa-e732-42a9-99ba-f5a93396e180 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:10 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-92def6aa-e732-42a9-99ba-f5a93396e180 tempest-VolumesSnapshotTestJSON-1795745985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:11:10 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-92def6aa-e732-42a9-99ba-f5a93396e180 tempest-VolumesSnapshotTestJSON-1795745985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:11:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-92def6aa-e732-42a9-99ba-f5a93396e180 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-92def6aa-e732-42a9-99ba-f5a93396e180 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:11 devstack sudo[94967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:11:11 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-02086c85-6e63-4d18-9c9a-6612d1fc88e7 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-cd18516c-6d9c-4569-bee9-ab36f4489ec2-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-02086c85-6e63-4d18-9c9a-6612d1fc88e7 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-cd18516c-6d9c-4569-bee9-ab36f4489ec2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-02086c85-6e63-4d18-9c9a-6612d1fc88e7 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-quobyte-c5206241-a925-4272-b1ae-47bc6a3a07ef" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-02086c85-6e63-4d18-9c9a-6612d1fc88e7 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-c5206241-a925-4272-b1ae-47bc6a3a07ef" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-02086c85-6e63-4d18-9c9a-6612d1fc88e7 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-quobyte-cd18516c-6d9c-4569-bee9-ab36f4489ec2" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-02086c85-6e63-4d18-9c9a-6612d1fc88e7 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-cd18516c-6d9c-4569-bee9-ab36f4489ec2" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:11 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-02086c85-6e63-4d18-9c9a-6612d1fc88e7 tempest-VolumesSnapshotTestJSON-1795745985 None] Deleting offline snapshot cd18516c-6d9c-4569-bee9-ab36f4489ec2 of volume c5206241-a925-4272-b1ae-47bc6a3a07ef {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:11:11 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-02086c85-6e63-4d18-9c9a-6612d1fc88e7 tempest-VolumesSnapshotTestJSON-1795745985 None] snapshot_file for this snap is: volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:11:11 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b9ee32-e1b6-4dd5-8feb-c61c4631d884]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02086c85-6e63-4d18-9c9a-6612d1fc88e7 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:11 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-92def6aa-e732-42a9-99ba-f5a93396e180 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.369s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:11 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-92def6aa-e732-42a9-99ba-f5a93396e180 tempest-VolumesSnapshotTestJSON-1795745985 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:11:11 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-92def6aa-e732-42a9-99ba-f5a93396e180 tempest-VolumesSnapshotTestJSON-1795745985 None] Deleted volume successfully.
Sep 28 18:11:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-92def6aa-e732-42a9-99ba-f5a93396e180 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-48543c4c-6ce2-4cf6-afe2-74702d9785b7-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:11 devstack sudo[94969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2
Sep 28 18:11:11 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:11 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02086c85-6e63-4d18-9c9a-6612d1fc88e7 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2" returned: 0 in 0.550s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:11 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-02086c85-6e63-4d18-9c9a-6612d1fc88e7 tempest-VolumesSnapshotTestJSON-1795745985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5206241-a925-4272-b1ae-47bc6a3a07ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:11:11 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbe9a61-fb49-40e0-a67f-0343a2f54d24]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02086c85-6e63-4d18-9c9a-6612d1fc88e7 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:11 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:11:11 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Flow 'volume_create_manager' (d1b070d7-61a2-4277-9874-355d717243d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:11:11 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1bc42c-fc65-47a1-8880-938670c91302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:12 devstack sudo[94975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef
Sep 28 18:11:12 devstack sudo[94975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1bc42c-fc65-47a1-8880-938670c91302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-890310534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=28884186-889b-4509-ae22-6b237015f287,host='devstack@QuobyteHD#QuobyteHD',id=28c3e989-4d7b-44b8-884b-89c7f1779009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e238fc908754b82be926348f117bde0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:12Z,use_quota=True,user_id='0063385e2ba347ccabc824cbb41c1d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a63a001-8294-4c82-b29e-95de60dab0b9),volume_type_id=8a63a001-8294-4c82-b29e-95de60dab0b9)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf0af0d-ad8b-4db5-8594-79fdb942a6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf0af0d-ad8b-4db5-8594-79fdb942a6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc786d8-d27c-447a-8f95-103404478052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc786d8-d27c-447a-8f95-103404478052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28c3e989-4d7b-44b8-884b-89c7f1779009', 'volume_name': 'volume-28c3e989-4d7b-44b8-884b-89c7f1779009', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1dd7e2-13ee-4afa-b780-41528ba04d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1dd7e2-13ee-4afa-b780-41528ba04d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49526227-6f67-456d-949f-009c803877ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:12 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Volume 28c3e989-4d7b-44b8-884b-89c7f1779009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28c3e989-4d7b-44b8-884b-89c7f1779009', 'volume_size': 1}
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=28884186-889b-4509-ae22-6b237015f287,created_at=2026-09-28T16:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-890310534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=28884186-889b-4509-ae22-6b237015f287,host='devstack@QuobyteHD#QuobyteHD',id=28c3e989-4d7b-44b8-884b-89c7f1779009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e238fc908754b82be926348f117bde0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:12Z,use_quota=True,user_id='0063385e2ba347ccabc824cbb41c1d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a63a001-8294-4c82-b29e-95de60dab0b9),volume_type_id=8a63a001-8294-4c82-b29e-95de60dab0b9)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Creating volume 28c3e989-4d7b-44b8-884b-89c7f1779009 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:11:12 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:12 devstack sudo[94977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009 1073741824
Sep 28 18:11:12 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:12 devstack sudo[94975]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02086c85-6e63-4d18-9c9a-6612d1fc88e7 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef" returned: 0 in 0.708s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02086c85-6e63-4d18-9c9a-6612d1fc88e7 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:12 devstack sudo[94987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2
Sep 28 18:11:12 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:12 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009 1073741824" returned: 0 in 0.611s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:12 devstack sudo[94989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009
Sep 28 18:11:12 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:13 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009" returned: 0 in 0.307s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:13 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:11:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49526227-6f67-456d-949f-009c803877ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28c3e989-4d7b-44b8-884b-89c7f1779009', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c38a59-711f-42ff-9403-e725c0d041b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:13 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Volume volume-28c3e989-4d7b-44b8-884b-89c7f1779009 (28c3e989-4d7b-44b8-884b-89c7f1779009): created successfully
Sep 28 18:11:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c38a59-711f-42ff-9403-e725c0d041b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:13 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Flow 'volume_create_manager' (d1b070d7-61a2-4277-9874-355d717243d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:11:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02086c85-6e63-4d18-9c9a-6612d1fc88e7 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2" returned: 0 in 0.547s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02086c85-6e63-4d18-9c9a-6612d1fc88e7 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:13 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-dd9b1dea-68f0-431c-ac8b-94d3292ecca8 tempest-GroupSnapshotsTest-1942732534 None] Created volume successfully.
Sep 28 18:11:13 devstack sudo[94996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2
Sep 28 18:11:13 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:13 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02086c85-6e63-4d18-9c9a-6612d1fc88e7 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef.cd18516c-6d9c-4569-bee9-ab36f4489ec2" returned: 0 in 0.310s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:13 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-02086c85-6e63-4d18-9c9a-6612d1fc88e7 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-cd18516c-6d9c-4569-bee9-ab36f4489ec2" released by "_delete_snapshot" :: held 2.299s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:13 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-02086c85-6e63-4d18-9c9a-6612d1fc88e7 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-c5206241-a925-4272-b1ae-47bc6a3a07ef" released by "delete_snapshot" :: held 2.337s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:13 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-02086c85-6e63-4d18-9c9a-6612d1fc88e7 tempest-VolumesSnapshotTestJSON-1795745985 None] Created reservations ['a61e86f0-444b-4911-a638-6e8b7060c880', 'a34bd6bd-d455-4673-a1fd-d7254dca44c0', 'bb60f1fd-c7ce-4c1f-ab52-14651bca3ca4', 'b878eff7-b685-4eb8-a04a-84ff525f2cd6'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:11:13 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-02086c85-6e63-4d18-9c9a-6612d1fc88e7 tempest-VolumesSnapshotTestJSON-1795745985 None] Delete snapshot completed successfully.
Sep 28 18:11:13 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-02086c85-6e63-4d18-9c9a-6612d1fc88e7 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-cd18516c-6d9c-4569-bee9-ab36f4489ec2-delete_snapshot" released by "delete_snapshot" :: held 2.520s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:14 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-80b6e8b3-cf58-4b17-9c96-70204431c264 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-c5206241-a925-4272-b1ae-47bc6a3a07ef-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:14 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-80b6e8b3-cf58-4b17-9c96-70204431c264 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-c5206241-a925-4272-b1ae-47bc6a3a07ef-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:14 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-80b6e8b3-cf58-4b17-9c96-70204431c264 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-quobyte-c5206241-a925-4272-b1ae-47bc6a3a07ef" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:14 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-80b6e8b3-cf58-4b17-9c96-70204431c264 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-c5206241-a925-4272-b1ae-47bc6a3a07ef" acquired by "delete_volume" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:14 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d530091-8cf7-4f87-af40-02264bf490ba]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-80b6e8b3-cf58-4b17-9c96-70204431c264 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:14 devstack sudo[94999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef
Sep 28 18:11:14 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:15 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-80b6e8b3-cf58-4b17-9c96-70204431c264 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef" returned: 0 in 0.539s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-80b6e8b3-cf58-4b17-9c96-70204431c264 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:15 devstack sudo[95005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef
Sep 28 18:11:15 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Flow 'volume_create_manager' (a946c3fb-ff46-4ca7-973d-0fd39f913e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0214e45f-61a1-49c5-ad08-1e6e0dbc01f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:15 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-80b6e8b3-cf58-4b17-9c96-70204431c264 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-c5206241-a925-4272-b1ae-47bc6a3a07ef" returned: 0 in 0.418s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0214e45f-61a1-49c5-ad08-1e6e0dbc01f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-571442665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=28884186-889b-4509-ae22-6b237015f287,host='devstack@QuobyteHD#QuobyteHD',id=1a47c7fd-de62-4505-acaf-f4c57a848320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e238fc908754b82be926348f117bde0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:15Z,use_quota=True,user_id='0063385e2ba347ccabc824cbb41c1d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a63a001-8294-4c82-b29e-95de60dab0b9),volume_type_id=8a63a001-8294-4c82-b29e-95de60dab0b9)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b8a2616-8efd-428b-81f2-be59f333c8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b8a2616-8efd-428b-81f2-be59f333c8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d030e1-c81c-46b0-924f-5e4a7bc6b832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d030e1-c81c-46b0-924f-5e4a7bc6b832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a47c7fd-de62-4505-acaf-f4c57a848320', 'volume_name': 'volume-1a47c7fd-de62-4505-acaf-f4c57a848320', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15479966-d8f4-450a-b6df-28ca485751dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15479966-d8f4-450a-b6df-28ca485751dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf61761-06b4-4ea9-9d9f-f335fd083e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:15 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Volume 1a47c7fd-de62-4505-acaf-f4c57a848320: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a47c7fd-de62-4505-acaf-f4c57a848320', 'volume_size': 1}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=28884186-889b-4509-ae22-6b237015f287,created_at=2026-09-28T16:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-571442665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=28884186-889b-4509-ae22-6b237015f287,host='devstack@QuobyteHD#QuobyteHD',id=1a47c7fd-de62-4505-acaf-f4c57a848320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e238fc908754b82be926348f117bde0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:15Z,use_quota=True,user_id='0063385e2ba347ccabc824cbb41c1d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a63a001-8294-4c82-b29e-95de60dab0b9),volume_type_id=8a63a001-8294-4c82-b29e-95de60dab0b9)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Creating volume 1a47c7fd-de62-4505-acaf-f4c57a848320 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:11:15 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-80b6e8b3-cf58-4b17-9c96-70204431c264 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-c5206241-a925-4272-b1ae-47bc6a3a07ef" released by "delete_volume" :: held 1.142s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:15 devstack sudo[95008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320 1073741824
Sep 28 18:11:15 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-80b6e8b3-cf58-4b17-9c96-70204431c264 tempest-VolumesSnapshotTestJSON-1795745985 None] Created reservations ['37cfc2b5-2e4f-431b-a492-bf537122a5ee', '1e3cfef5-dfc3-4823-bc61-4be9911b885b', '9b59aa54-2da2-4739-9a82-732692db7d38', 'e92f0d69-62de-4fd4-bf52-666cf78e20b4'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-80b6e8b3-cf58-4b17-9c96-70204431c264 tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-80b6e8b3-cf58-4b17-9c96-70204431c264 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-80b6e8b3-cf58-4b17-9c96-70204431c264 tempest-VolumesSnapshotTestJSON-1795745985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-80b6e8b3-cf58-4b17-9c96-70204431c264 tempest-VolumesSnapshotTestJSON-1795745985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-80b6e8b3-cf58-4b17-9c96-70204431c264 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-80b6e8b3-cf58-4b17-9c96-70204431c264 tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:15 devstack sudo[95010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:11:15 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:16 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-80b6e8b3-cf58-4b17-9c96-70204431c264 tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.337s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:16 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-80b6e8b3-cf58-4b17-9c96-70204431c264 tempest-VolumesSnapshotTestJSON-1795745985 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:11:16 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-80b6e8b3-cf58-4b17-9c96-70204431c264 tempest-VolumesSnapshotTestJSON-1795745985 None] Deleted volume successfully.
Sep 28 18:11:16 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-80b6e8b3-cf58-4b17-9c96-70204431c264 tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-c5206241-a925-4272-b1ae-47bc6a3a07ef-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:16 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320 1073741824" returned: 0 in 0.664s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:16 devstack sudo[95017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320
Sep 28 18:11:16 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:16 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320" returned: 0 in 0.381s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:11:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf61761-06b4-4ea9-9d9f-f335fd083e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a47c7fd-de62-4505-acaf-f4c57a848320', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e57e5c-1fd2-41ac-a41f-5e71dbb8f04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:16 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Volume volume-1a47c7fd-de62-4505-acaf-f4c57a848320 (1a47c7fd-de62-4505-acaf-f4c57a848320): created successfully
Sep 28 18:11:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e57e5c-1fd2-41ac-a41f-5e71dbb8f04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Flow 'volume_create_manager' (a946c3fb-ff46-4ca7-973d-0fd39f913e4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:11:16 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ca3bad7f-c48e-4801-85db-6fcbc680556d tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-dd51056e-9229-486a-9aee-97a63aaf4aa5-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:16 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-5f4f7e27-3042-462d-b5eb-fe20276da5b2 tempest-GroupSnapshotsTest-1942732534 None] Created volume successfully.
Sep 28 18:11:16 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ca3bad7f-c48e-4801-85db-6fcbc680556d tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-dd51056e-9229-486a-9aee-97a63aaf4aa5-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:17 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ca3bad7f-c48e-4801-85db-6fcbc680556d tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "cinder-quobyte-dd51056e-9229-486a-9aee-97a63aaf4aa5" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:17 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ca3bad7f-c48e-4801-85db-6fcbc680556d tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-dd51056e-9229-486a-9aee-97a63aaf4aa5" acquired by "delete_volume" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:17 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c02e6bb-691b-4cea-9b22-608f465111cb]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ca3bad7f-c48e-4801-85db-6fcbc680556d tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:17 devstack sudo[95020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5
Sep 28 18:11:17 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:17 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ca3bad7f-c48e-4801-85db-6fcbc680556d tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5" returned: 0 in 0.504s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ca3bad7f-c48e-4801-85db-6fcbc680556d tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:17 devstack sudo[95025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5
Sep 28 18:11:17 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:18 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ca3bad7f-c48e-4801-85db-6fcbc680556d tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-dd51056e-9229-486a-9aee-97a63aaf4aa5" returned: 0 in 0.525s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:18 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ca3bad7f-c48e-4801-85db-6fcbc680556d tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-quobyte-dd51056e-9229-486a-9aee-97a63aaf4aa5" released by "delete_volume" :: held 1.133s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:18 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=102,cinder:INSERT=25,cinder:UPDATE=105,cinder:DELETE=7 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:11:18 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:UPDATE=95,cinder:SELECT=94,cinder:DELETE=4,cinder:INSERT=23 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:11:18 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-ca3bad7f-c48e-4801-85db-6fcbc680556d tempest-VolumesSnapshotTestJSON-1795745985 None] Created reservations ['1cba282c-19eb-4db8-8750-638a0af6a3f8', '4ae05bcb-db24-4f22-b73c-dfeca83b432e', 'f134f873-1f33-4d55-ba96-1e05f86cf1c0', '28af734b-a0d1-43df-a7c2-dde804085fd8'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:11:18 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-56772083-8d95-46f2-b2d9-1f8b0dcbff64 tempest-GroupSnapshotsTest-1942732534 None] Update group completed successfully.
Sep 28 18:11:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ca3bad7f-c48e-4801-85db-6fcbc680556d tempest-VolumesSnapshotTestJSON-1795745985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ca3bad7f-c48e-4801-85db-6fcbc680556d tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:18 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ca3bad7f-c48e-4801-85db-6fcbc680556d tempest-VolumesSnapshotTestJSON-1795745985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:11:18 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ca3bad7f-c48e-4801-85db-6fcbc680556d tempest-VolumesSnapshotTestJSON-1795745985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:11:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ca3bad7f-c48e-4801-85db-6fcbc680556d tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ca3bad7f-c48e-4801-85db-6fcbc680556d tempest-VolumesSnapshotTestJSON-1795745985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:18 devstack sudo[95062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:11:18 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:19 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ca3bad7f-c48e-4801-85db-6fcbc680556d tempest-VolumesSnapshotTestJSON-1795745985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.544s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:19 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-ca3bad7f-c48e-4801-85db-6fcbc680556d tempest-VolumesSnapshotTestJSON-1795745985 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:11:19 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-ca3bad7f-c48e-4801-85db-6fcbc680556d tempest-VolumesSnapshotTestJSON-1795745985 None] Deleted volume successfully.
Sep 28 18:11:19 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ca3bad7f-c48e-4801-85db-6fcbc680556d tempest-VolumesSnapshotTestJSON-1795745985 None] Lock "cinder-dd51056e-9229-486a-9aee-97a63aaf4aa5-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:19 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-eae6a74f-2381-4fd0-8e1e-8595103bac1b tempest-GroupSnapshotsTest-1942732534 None] Update group completed successfully.
Sep 28 18:11:20 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-1b25becd-571b-4e5e-b50e-912e08ea8c55 tempest-GroupSnapshotsTest-1942732534 None] Update group completed successfully.
Sep 28 18:11:22 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-e56cbcfe-a7e6-4f46-9e7e-c9905a1b27f0 tempest-GroupSnapshotsTest-1942732534 None] Update group completed successfully.
Sep 28 18:11:22 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:11:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Flow 'volume_create_manager' (eb2638f2-a764-4fa4-b9a3-c24fe0cc47eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:11:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd492b11-5657-42ee-987a-4780811536ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd492b11-5657-42ee-987a-4780811536ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-689082816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0434ed49-37cd-4226-ae90-d35e0e3d0e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7325593693457689d666277b24ab60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:22Z,use_quota=True,user_id='556fd34e468b429aaf8f8c55e04dc803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f58ca2b-265e-4a57-800a-271f2d17c048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f58ca2b-265e-4a57-800a-271f2d17c048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0a68a2-0816-4e3b-952b-914db3ac534a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0a68a2-0816-4e3b-952b-914db3ac534a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0434ed49-37cd-4226-ae90-d35e0e3d0e83', 'volume_name': 'volume-0434ed49-37cd-4226-ae90-d35e0e3d0e83', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af44289-789b-4b14-a18c-8a48bf18e081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af44289-789b-4b14-a18c-8a48bf18e081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1128408c-8970-4199-bc53-ba69a7c23da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:22 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Volume 0434ed49-37cd-4226-ae90-d35e0e3d0e83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0434ed49-37cd-4226-ae90-d35e0e3d0e83', 'volume_size': 1}
Sep 28 18:11:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:22 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-689082816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0434ed49-37cd-4226-ae90-d35e0e3d0e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7325593693457689d666277b24ab60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:22Z,use_quota=True,user_id='556fd34e468b429aaf8f8c55e04dc803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:11:22 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Creating volume 0434ed49-37cd-4226-ae90-d35e0e3d0e83 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:11:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:22 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:11:22 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:11:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:22 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:11:22 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:11:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0434ed49-37cd-4226-ae90-d35e0e3d0e83 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:22 devstack sudo[95072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0434ed49-37cd-4226-ae90-d35e0e3d0e83 1073741824
Sep 28 18:11:22 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:23 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0434ed49-37cd-4226-ae90-d35e0e3d0e83 1073741824" returned: 0 in 0.568s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0434ed49-37cd-4226-ae90-d35e0e3d0e83 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:23 devstack sudo[95082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0434ed49-37cd-4226-ae90-d35e0e3d0e83
Sep 28 18:11:23 devstack sudo[95082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:23 devstack sudo[95082]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0434ed49-37cd-4226-ae90-d35e0e3d0e83" returned: 0 in 0.403s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:23 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:11:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:23 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1128408c-8970-4199-bc53-ba69a7c23da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0434ed49-37cd-4226-ae90-d35e0e3d0e83', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:23 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de4a6d9-a8a8-4a3c-b21c-0e75c0f683f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:23 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Volume volume-0434ed49-37cd-4226-ae90-d35e0e3d0e83 (0434ed49-37cd-4226-ae90-d35e0e3d0e83): created successfully
Sep 28 18:11:23 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de4a6d9-a8a8-4a3c-b21c-0e75c0f683f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:23 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Flow 'volume_create_manager' (eb2638f2-a764-4fa4-b9a3-c24fe0cc47eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:11:23 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-a71a7a83-f54d-4576-8301-476d36d0f83d tempest-VolumesServicesTestJSON-664609852 None] Created volume successfully.
Sep 28 18:11:23 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] GroupSnapshot 173dad25-1622-4b32-a95a-b953a77fa782: creating.
Sep 28 18:11:24 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] Group snapshot 173dad25-1622-4b32-a95a-b953a77fa782: creating. {{(pid=87046) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 28 18:11:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] Creating offline snapshot b299b719-f9ec-4d53-bd18-4b60f973fb38 of volume 28c3e989-4d7b-44b8-884b-89c7f1779009 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:11:24 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:11:24 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Flow 'volume_create_manager' (3318708c-7b04-4ee0-8dcd-d362e5acd51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:11:24 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc8d2b7-1ec3-4790-91cf-2fb06d0c548d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:24 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[760d661e-e993-4474-9a98-ad5cbe3fb4de]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:24 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc8d2b7-1ec3-4790-91cf-2fb06d0c548d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-974159943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4617f551-20b9-4bed-bdb6-5758c1c47441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05195898e62a4a92ae9ba40425182674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:24Z,use_quota=True,user_id='e2eca852aa934d6ab40133dfda0eeca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:24 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a65867b-69df-4ad4-bf2c-290fb4e9abb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:24 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a65867b-69df-4ad4-bf2c-290fb4e9abb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:24 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598979a9-94ef-4aa8-be11-423a96c3f602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:24 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598979a9-94ef-4aa8-be11-423a96c3f602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4617f551-20b9-4bed-bdb6-5758c1c47441', 'volume_name': 'volume-4617f551-20b9-4bed-bdb6-5758c1c47441', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:24 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce7186f-8a84-405e-8afb-b006d77fe013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:24 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce7186f-8a84-405e-8afb-b006d77fe013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:24 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b6a6e1-787a-4f2a-8e03-bc31c4949605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:24 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Volume 4617f551-20b9-4bed-bdb6-5758c1c47441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4617f551-20b9-4bed-bdb6-5758c1c47441', 'volume_size': 1}
Sep 28 18:11:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:24 devstack sudo[95085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009
Sep 28 18:11:24 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:24 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009" returned: 0 in 0.431s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.b299b719-f9ec-4d53-bd18-4b60f973fb38 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:24 devstack sudo[95092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.b299b719-f9ec-4d53-bd18-4b60f973fb38 1G
Sep 28 18:11:24 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c53dce4c-f41e-4242-a2be-f5884281b322 tempest-VolumesServicesTestJSON-664609852 None] Acquiring lock "cinder-0434ed49-37cd-4226-ae90-d35e0e3d0e83-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c53dce4c-f41e-4242-a2be-f5884281b322 tempest-VolumesServicesTestJSON-664609852 None] Lock "cinder-0434ed49-37cd-4226-ae90-d35e0e3d0e83-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:25 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.b299b719-f9ec-4d53-bd18-4b60f973fb38 1G" returned: 0 in 0.609s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28c3e989-4d7b-44b8-884b-89c7f1779009 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.b299b719-f9ec-4d53-bd18-4b60f973fb38 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:25 devstack sudo[95098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28c3e989-4d7b-44b8-884b-89c7f1779009 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.b299b719-f9ec-4d53-bd18-4b60f973fb38
Sep 28 18:11:25 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c53dce4c-f41e-4242-a2be-f5884281b322 tempest-VolumesServicesTestJSON-664609852 None] Acquiring lock "cinder-quobyte-0434ed49-37cd-4226-ae90-d35e0e3d0e83" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c53dce4c-f41e-4242-a2be-f5884281b322 tempest-VolumesServicesTestJSON-664609852 None] Lock "cinder-quobyte-0434ed49-37cd-4226-ae90-d35e0e3d0e83" acquired by "delete_volume" :: waited 0.019s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:25 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc55208d-6cff-4891-aa79-cc734a0614ad]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c53dce4c-f41e-4242-a2be-f5884281b322 tempest-VolumesServicesTestJSON-664609852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0434ed49-37cd-4226-ae90-d35e0e3d0e83 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:25 devstack sudo[95100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0434ed49-37cd-4226-ae90-d35e0e3d0e83
Sep 28 18:11:25 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:25 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28c3e989-4d7b-44b8-884b-89c7f1779009 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.b299b719-f9ec-4d53-bd18-4b60f973fb38" returned: 0 in 0.364s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:25 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.b299b719-f9ec-4d53-bd18-4b60f973fb38 is being set with open permissions: ugo+rw: NotImplementedError
Sep 28 18:11:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.b299b719-f9ec-4d53-bd18-4b60f973fb38 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:25 devstack sudo[95105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.b299b719-f9ec-4d53-bd18-4b60f973fb38
Sep 28 18:11:25 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:25 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c53dce4c-f41e-4242-a2be-f5884281b322 tempest-VolumesServicesTestJSON-664609852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0434ed49-37cd-4226-ae90-d35e0e3d0e83" returned: 0 in 0.490s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c53dce4c-f41e-4242-a2be-f5884281b322 tempest-VolumesServicesTestJSON-664609852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0434ed49-37cd-4226-ae90-d35e0e3d0e83 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:25 devstack sudo[95110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0434ed49-37cd-4226-ae90-d35e0e3d0e83
Sep 28 18:11:25 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:25 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.b299b719-f9ec-4d53-bd18-4b60f973fb38" returned: 0 in 0.318s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:25 devstack sudo[95114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.info
Sep 28 18:11:25 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:26 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c53dce4c-f41e-4242-a2be-f5884281b322 tempest-VolumesServicesTestJSON-664609852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0434ed49-37cd-4226-ae90-d35e0e3d0e83" returned: 0 in 0.399s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:26 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c53dce4c-f41e-4242-a2be-f5884281b322 tempest-VolumesServicesTestJSON-664609852 None] Lock "cinder-quobyte-0434ed49-37cd-4226-ae90-d35e0e3d0e83" released by "delete_volume" :: held 0.965s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:26 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.info" returned: 0 in 0.375s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:26 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 28 18:11:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:26 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-c53dce4c-f41e-4242-a2be-f5884281b322 tempest-VolumesServicesTestJSON-664609852 None] Created reservations ['03444ef7-5698-4db5-9d94-ee976870b01f', 'e41c50ea-eef8-40e3-9907-adc4c69c1947', '18a2f6a5-cb88-421a-bc0b-d80dbbf52953', '46e2b652-3a81-405f-94fb-f4772f7932ca'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:11:26 devstack sudo[95118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.info
Sep 28 18:11:26 devstack sudo[95118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c53dce4c-f41e-4242-a2be-f5884281b322 tempest-VolumesServicesTestJSON-664609852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c53dce4c-f41e-4242-a2be-f5884281b322 tempest-VolumesServicesTestJSON-664609852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c53dce4c-f41e-4242-a2be-f5884281b322 tempest-VolumesServicesTestJSON-664609852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:11:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c53dce4c-f41e-4242-a2be-f5884281b322 tempest-VolumesServicesTestJSON-664609852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:11:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c53dce4c-f41e-4242-a2be-f5884281b322 tempest-VolumesServicesTestJSON-664609852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c53dce4c-f41e-4242-a2be-f5884281b322 tempest-VolumesServicesTestJSON-664609852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:26 devstack sudo[95120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:11:26 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:26 devstack sudo[95118]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.info" returned: 0 in 0.314s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.580s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] Creating offline snapshot b4955ab3-3969-412c-b684-5505fb85623b of volume 1a47c7fd-de62-4505-acaf-f4c57a848320 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:11:26 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66174c6-b67b-489a-a5d9-ed7ffc26a574]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:26 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c53dce4c-f41e-4242-a2be-f5884281b322 tempest-VolumesServicesTestJSON-664609852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.364s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:26 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-c53dce4c-f41e-4242-a2be-f5884281b322 tempest-VolumesServicesTestJSON-664609852 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:11:26 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-c53dce4c-f41e-4242-a2be-f5884281b322 tempest-VolumesServicesTestJSON-664609852 None] Deleted volume successfully.
Sep 28 18:11:26 devstack sudo[95123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320
Sep 28 18:11:26 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c53dce4c-f41e-4242-a2be-f5884281b322 tempest-VolumesServicesTestJSON-664609852 None] Lock "cinder-0434ed49-37cd-4226-ae90-d35e0e3d0e83-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:26 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:27 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320" returned: 0 in 0.486s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.b4955ab3-3969-412c-b684-5505fb85623b 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:27 devstack sudo[95129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.b4955ab3-3969-412c-b684-5505fb85623b 1G
Sep 28 18:11:27 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:27 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.b4955ab3-3969-412c-b684-5505fb85623b 1G" returned: 0 in 0.624s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a47c7fd-de62-4505-acaf-f4c57a848320 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.b4955ab3-3969-412c-b684-5505fb85623b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:27 devstack sudo[95135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a47c7fd-de62-4505-acaf-f4c57a848320 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.b4955ab3-3969-412c-b684-5505fb85623b
Sep 28 18:11:27 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:28 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a47c7fd-de62-4505-acaf-f4c57a848320 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.b4955ab3-3969-412c-b684-5505fb85623b" returned: 0 in 0.445s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:28 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.b4955ab3-3969-412c-b684-5505fb85623b is being set with open permissions: ugo+rw: NotImplementedError
Sep 28 18:11:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.b4955ab3-3969-412c-b684-5505fb85623b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:28 devstack sudo[95141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.b4955ab3-3969-412c-b684-5505fb85623b
Sep 28 18:11:28 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:28 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.b4955ab3-3969-412c-b684-5505fb85623b" returned: 0 in 0.311s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:28 devstack sudo[95144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.info
Sep 28 18:11:28 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:28 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.info" returned: 0 in 0.295s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:28 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 28 18:11:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:28 devstack sudo[95147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.info
Sep 28 18:11:28 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:29 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.info" returned: 0 in 0.291s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.576s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.035s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-974159943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4617f551-20b9-4bed-bdb6-5758c1c47441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05195898e62a4a92ae9ba40425182674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:24Z,use_quota=True,user_id='e2eca852aa934d6ab40133dfda0eeca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:11:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Creating volume 4617f551-20b9-4bed-bdb6-5758c1c47441 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:11:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:11:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:11:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:11:29 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:11:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4617f551-20b9-4bed-bdb6-5758c1c47441 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:29 devstack sudo[95150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4617f551-20b9-4bed-bdb6-5758c1c47441 1073741824
Sep 28 18:11:29 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:29 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-0818fdf9-4f41-4e68-a577-b2e6b66be785 tempest-GroupSnapshotsTest-1942732534 None] group_snapshot 173dad25-1622-4b32-a95a-b953a77fa782: created successfully
Sep 28 18:11:29 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4617f551-20b9-4bed-bdb6-5758c1c47441 1073741824" returned: 0 in 0.739s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4617f551-20b9-4bed-bdb6-5758c1c47441 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:30 devstack sudo[95156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4617f551-20b9-4bed-bdb6-5758c1c47441
Sep 28 18:11:30 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:30 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4617f551-20b9-4bed-bdb6-5758c1c47441" returned: 0 in 0.341s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:11:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b6a6e1-787a-4f2a-8e03-bc31c4949605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4617f551-20b9-4bed-bdb6-5758c1c47441', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8f2b8a-65a3-4ffe-ad4d-1c11fed947c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:30 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Volume volume-4617f551-20b9-4bed-bdb6-5758c1c47441 (4617f551-20b9-4bed-bdb6-5758c1c47441): created successfully
Sep 28 18:11:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8f2b8a-65a3-4ffe-ad4d-1c11fed947c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Flow 'volume_create_manager' (3318708c-7b04-4ee0-8dcd-d362e5acd51c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:11:30 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d455b7e9-124e-4116-830a-f33f13435202 tempest-AttachVolumeTestJSON-721645988 None] Created volume successfully.
Sep 28 18:11:30 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] group_snapshot 173dad25-1622-4b32-a95a-b953a77fa782: deleting
Sep 28 18:11:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] group_snapshot 173dad25-1622-4b32-a95a-b953a77fa782: deleting {{(pid=87046) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 28 18:11:30 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "cinder-quobyte-28c3e989-4d7b-44b8-884b-89c7f1779009" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:30 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-28c3e989-4d7b-44b8-884b-89c7f1779009" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:30 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "cinder-quobyte-b299b719-f9ec-4d53-bd18-4b60f973fb38" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:30 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-b299b719-f9ec-4d53-bd18-4b60f973fb38" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Deleting offline snapshot b299b719-f9ec-4d53-bd18-4b60f973fb38 of volume 28c3e989-4d7b-44b8-884b-89c7f1779009 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:11:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] snapshot_file for this snap is: volume-28c3e989-4d7b-44b8-884b-89c7f1779009.b299b719-f9ec-4d53-bd18-4b60f973fb38 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:11:30 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ced189-6aa1-44b2-bfb3-5b8bd980ef46]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.b299b719-f9ec-4d53-bd18-4b60f973fb38 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:31 devstack sudo[95161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.b299b719-f9ec-4d53-bd18-4b60f973fb38
Sep 28 18:11:31 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:31 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.b299b719-f9ec-4d53-bd18-4b60f973fb38" returned: 0 in 0.728s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:31 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28c3e989-4d7b-44b8-884b-89c7f1779009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:11:31 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ae7616-4c2f-4a8f-81ad-b5f0e9feeaa0]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:31 devstack sudo[95175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009
Sep 28 18:11:31 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-644097c0-9b1c-4bfc-ba02-212fec1b82d9 req-d36cd5c0-e71d-46cc-ab26-00b5bcb4b9a6 tempest-AttachVolumeTestJSON-721645988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-644097c0-9b1c-4bfc-ba02-212fec1b82d9 req-d36cd5c0-e71d-46cc-ab26-00b5bcb4b9a6 tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-644097c0-9b1c-4bfc-ba02-212fec1b82d9 req-d36cd5c0-e71d-46cc-ab26-00b5bcb4b9a6 tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-644097c0-9b1c-4bfc-ba02-212fec1b82d9 req-d36cd5c0-e71d-46cc-ab26-00b5bcb4b9a6 tempest-AttachVolumeTestJSON-721645988 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-4617f551-20b9-4bed-bdb6-5758c1c47441', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '669befa2-ef30-469f-9649-18db9eb25b87', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:11:32 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-644097c0-9b1c-4bfc-ba02-212fec1b82d9 req-d36cd5c0-e71d-46cc-ab26-00b5bcb4b9a6 tempest-AttachVolumeTestJSON-721645988 None] attachment_update completed successfully.
Sep 28 18:11:32 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009" returned: 0 in 0.677s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.b299b719-f9ec-4d53-bd18-4b60f973fb38 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:32 devstack sudo[95209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.b299b719-f9ec-4d53-bd18-4b60f973fb38
Sep 28 18:11:32 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:32 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.b299b719-f9ec-4d53-bd18-4b60f973fb38" returned: 0 in 0.472s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.b299b719-f9ec-4d53-bd18-4b60f973fb38 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:32 devstack sudo[95607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.b299b719-f9ec-4d53-bd18-4b60f973fb38
Sep 28 18:11:32 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:33 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009.b299b719-f9ec-4d53-bd18-4b60f973fb38" returned: 0 in 0.494s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:33 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-b299b719-f9ec-4d53-bd18-4b60f973fb38" released by "_delete_snapshot" :: held 2.606s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:33 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-28c3e989-4d7b-44b8-884b-89c7f1779009" released by "delete_snapshot" :: held 2.641s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:33 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "cinder-quobyte-1a47c7fd-de62-4505-acaf-f4c57a848320" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:33 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-1a47c7fd-de62-4505-acaf-f4c57a848320" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:33 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "cinder-quobyte-b4955ab3-3969-412c-b684-5505fb85623b" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:33 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-b4955ab3-3969-412c-b684-5505fb85623b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Deleting offline snapshot b4955ab3-3969-412c-b684-5505fb85623b of volume 1a47c7fd-de62-4505-acaf-f4c57a848320 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:11:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] snapshot_file for this snap is: volume-1a47c7fd-de62-4505-acaf-f4c57a848320.b4955ab3-3969-412c-b684-5505fb85623b {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:11:33 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccee487-093c-4c8c-b37d-4eadef8f6520]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.b4955ab3-3969-412c-b684-5505fb85623b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:33 devstack sudo[95611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.b4955ab3-3969-412c-b684-5505fb85623b
Sep 28 18:11:33 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:34 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.b4955ab3-3969-412c-b684-5505fb85623b" returned: 0 in 0.575s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:34 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a47c7fd-de62-4505-acaf-f4c57a848320(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:11:34 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dd6f85-ac4d-4479-8fd0-6af31958ae59]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:34 devstack sudo[95616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320
Sep 28 18:11:34 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:34 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320" returned: 0 in 0.638s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.b4955ab3-3969-412c-b684-5505fb85623b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:34 devstack sudo[95622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.b4955ab3-3969-412c-b684-5505fb85623b
Sep 28 18:11:34 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Flow 'volume_create_manager' (14137cd6-4a49-44ec-84f0-31a5b414a65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dcbd366-27e5-4b5e-83d3-d3f1c27cef7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dcbd366-27e5-4b5e-83d3-d3f1c27cef7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-909074108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f76b505d-e120-4645-8396-dccc4a717b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05195898e62a4a92ae9ba40425182674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:35Z,use_quota=True,user_id='e2eca852aa934d6ab40133dfda0eeca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14218c65-9f52-4f8a-aee4-9da269774160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14218c65-9f52-4f8a-aee4-9da269774160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e561be8-479e-43fd-b8d0-7a810bab50f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e561be8-479e-43fd-b8d0-7a810bab50f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f76b505d-e120-4645-8396-dccc4a717b79', 'volume_name': 'volume-f76b505d-e120-4645-8396-dccc4a717b79', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5eb7dc-539c-4242-aef9-5036eaca99fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5eb7dc-539c-4242-aef9-5036eaca99fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da71ea3f-342b-4d14-b72f-d1ad778f6000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:35 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Volume f76b505d-e120-4645-8396-dccc4a717b79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f76b505d-e120-4645-8396-dccc4a717b79', 'volume_size': 1}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-909074108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f76b505d-e120-4645-8396-dccc4a717b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05195898e62a4a92ae9ba40425182674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:35Z,use_quota=True,user_id='e2eca852aa934d6ab40133dfda0eeca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Creating volume f76b505d-e120-4645-8396-dccc4a717b79 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:11:35 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f76b505d-e120-4645-8396-dccc4a717b79 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:35 devstack sudo[95627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f76b505d-e120-4645-8396-dccc4a717b79 1073741824
Sep 28 18:11:35 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:35 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.b4955ab3-3969-412c-b684-5505fb85623b" returned: 0 in 0.679s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.b4955ab3-3969-412c-b684-5505fb85623b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:35 devstack sudo[95630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.b4955ab3-3969-412c-b684-5505fb85623b
Sep 28 18:11:35 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:35 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320.b4955ab3-3969-412c-b684-5505fb85623b" returned: 0 in 0.407s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:35 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f76b505d-e120-4645-8396-dccc4a717b79 1073741824" returned: 0 in 0.643s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-b4955ab3-3969-412c-b684-5505fb85623b" released by "_delete_snapshot" :: held 2.485s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-1a47c7fd-de62-4505-acaf-f4c57a848320" released by "delete_snapshot" :: held 2.522s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f76b505d-e120-4645-8396-dccc4a717b79 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:36 devstack sudo[95637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f76b505d-e120-4645-8396-dccc4a717b79
Sep 28 18:11:36 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:36 devstack cinder-volume[87046]: WARNING cinder.quota [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1403555233 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1403555233, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:11:36 devstack cinder-volume[87046]: WARNING cinder.quota [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1403555233 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1403555233, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:11:36 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Created reservations ['7c1ff3d0-e361-4c5e-8df0-5368fbcd822f', 'fb0b0860-34ac-41ab-a39b-e133e70f2b4b', 'bc50dd73-87f5-47dd-82d4-46c21a8a60e6', '7410ef11-c2d5-429c-a48e-38288d468ab1'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:11:36 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] Created reservations ['946e2a0d-ec21-49ef-9014-c9340ef0d87b', '29ecb78b-e78f-444d-adae-dae2ceab3b3c', 'cc68a2fe-32c9-4ba5-b451-5144a2c0870d', '3e62fb26-0be6-479d-a598-6b3128a63270'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:11:36 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f76b505d-e120-4645-8396-dccc4a717b79" returned: 0 in 0.358s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:11:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da71ea3f-342b-4d14-b72f-d1ad778f6000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f76b505d-e120-4645-8396-dccc4a717b79', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9ff15f-a29c-4460-b706-8eddde4b8bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:36 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Volume volume-f76b505d-e120-4645-8396-dccc4a717b79 (f76b505d-e120-4645-8396-dccc4a717b79): created successfully
Sep 28 18:11:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9ff15f-a29c-4460-b706-8eddde4b8bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Flow 'volume_create_manager' (14137cd6-4a49-44ec-84f0-31a5b414a65b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:11:36 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-33f746f0-215f-41e4-84e8-d5d755bcb970 tempest-AttachVolumeTestJSON-721645988 None] Created volume successfully.
Sep 28 18:11:36 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-b925048d-dd0d-4e9c-a442-5126367f4a74 tempest-GroupSnapshotsTest-1942732534 None] group_snapshot 173dad25-1622-4b32-a95a-b953a77fa782: deleted successfully
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "cinder-quobyte-1a47c7fd-de62-4505-acaf-f4c57a848320" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-1a47c7fd-de62-4505-acaf-f4c57a848320" acquired by "delete_volume" :: waited 0.056s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1200b197-993f-4efa-bdbf-a92bc8529a95]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:11:37 devstack sudo[95640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Flow 'volume_create_manager' (249815c7-27f6-48f8-9b56-238a1f6e3f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:11:37 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e240b63f-25f5-4bc9-bf04-cc7fdb605908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e240b63f-25f5-4bc9-bf04-cc7fdb605908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1257018682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=700b722c-0c65-43d6-80d2-38902e022cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16dc96cadc0f434a8d0eb1d5cf1d3be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:38Z,use_quota=True,user_id='c8764d8c21574ac9a85fd3e1e7aa65eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5fabd15-7919-41fa-ae52-0df1425c7fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5fabd15-7919-41fa-ae52-0df1425c7fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94676ed9-69ba-45f2-acbc-9c474c36e590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94676ed9-69ba-45f2-acbc-9c474c36e590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '700b722c-0c65-43d6-80d2-38902e022cae', 'volume_name': 'volume-700b722c-0c65-43d6-80d2-38902e022cae', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb7bf65-821e-4f79-b258-71293ac292be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb7bf65-821e-4f79-b258-71293ac292be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b30540a-b78b-414f-8156-9e15aa113e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:37 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Volume 700b722c-0c65-43d6-80d2-38902e022cae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-700b722c-0c65-43d6-80d2-38902e022cae', 'volume_size': 1}
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1257018682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=700b722c-0c65-43d6-80d2-38902e022cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16dc96cadc0f434a8d0eb1d5cf1d3be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:38Z,use_quota=True,user_id='c8764d8c21574ac9a85fd3e1e7aa65eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Creating volume 700b722c-0c65-43d6-80d2-38902e022cae {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:11:37 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:11:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:37 devstack sudo[95647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae 1073741824
Sep 28 18:11:37 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:38 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320" returned: 0 in 0.555s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:38 devstack sudo[95653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320
Sep 28 18:11:38 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:38 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae 1073741824" returned: 0 in 0.737s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:38 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1a47c7fd-de62-4505-acaf-f4c57a848320" returned: 0 in 0.592s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-1a47c7fd-de62-4505-acaf-f4c57a848320" released by "delete_volume" :: held 1.314s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "cinder-quobyte-28c3e989-4d7b-44b8-884b-89c7f1779009" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-28c3e989-4d7b-44b8-884b-89c7f1779009" acquired by "delete_volume" :: waited 0.023s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:38 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d9d790-c6de-4563-aa09-2916c7c1fba8]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:38 devstack sudo[95668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae
Sep 28 18:11:38 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-99a79db7-d8f8-4887-bd75-f5289639fba4 req-0493442e-e606-479a-b522-42e7c86a22d7 tempest-AttachVolumeTestJSON-721645988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:38 devstack sudo[95669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009
Sep 28 18:11:38 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:39 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae" returned: 0 in 0.427s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-99a79db7-d8f8-4887-bd75-f5289639fba4 req-0493442e-e606-479a-b522-42e7c86a22d7 tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.309s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b30540a-b78b-414f-8156-9e15aa113e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-700b722c-0c65-43d6-80d2-38902e022cae', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6483fb51-07e6-49e0-a245-044c3add17e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-99a79db7-d8f8-4887-bd75-f5289639fba4 req-0493442e-e606-479a-b522-42e7c86a22d7 tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:39 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Volume volume-700b722c-0c65-43d6-80d2-38902e022cae (700b722c-0c65-43d6-80d2-38902e022cae): created successfully
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6483fb51-07e6-49e0-a245-044c3add17e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Flow 'volume_create_manager' (249815c7-27f6-48f8-9b56-238a1f6e3f08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:11:39 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:39 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-373feb1a-f3ce-4855-98a8-7432db09d410 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Created volume successfully.
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009" returned: 0 in 0.540s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:39 devstack sudo[95676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009
Sep 28 18:11:39 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-99a79db7-d8f8-4887-bd75-f5289639fba4 req-0493442e-e606-479a-b522-42e7c86a22d7 tempest-AttachVolumeTestJSON-721645988 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-f76b505d-e120-4645-8396-dccc4a717b79', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c4b55eb-39b1-4cb4-9c08-7cce282cf822', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:11:39 devstack sudo[95678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:11:39 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:39 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-99a79db7-d8f8-4887-bd75-f5289639fba4 req-0493442e-e606-479a-b522-42e7c86a22d7 tempest-AttachVolumeTestJSON-721645988 None] attachment_update completed successfully.
Sep 28 18:11:39 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.407s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:11:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:11:40 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-28c3e989-4d7b-44b8-884b-89c7f1779009" returned: 0 in 0.696s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-28c3e989-4d7b-44b8-884b-89c7f1779009" released by "delete_volume" :: held 1.369s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-643997df-fbac-4ae0-adf2-18af35d91c3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-643997df-fbac-4ae0-adf2-18af35d91c3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-643997df-fbac-4ae0-adf2-18af35d91c3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Creating offline snapshot 761dfb17-94d6-4071-87d3-857abde2152b of volume 700b722c-0c65-43d6-80d2-38902e022cae {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:11:40 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] Created reservations ['8565ce27-e7d6-496b-a863-2d75d24477a1'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:11:40 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcbed40-fd48-4c60-a65a-0a7702dcbc0e]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-643997df-fbac-4ae0-adf2-18af35d91c3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:40 devstack cinder-volume[87046]: WARNING cinder.quota [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1403555233 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1403555233, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:11:40 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] Created reservations ['a1915a6a-8b99-4110-acd7-6a39cb04ce53', '6a8d99cf-4612-4d1c-8d58-c1134fda13a7', '055324ad-c813-456a-90ae-ca0c54277285', '6f3319e7-0cbb-4f8e-be2f-0dc2a6a10ea4'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:11:40 devstack sudo[95687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae
Sep 28 18:11:40 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:40 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] Created reservations ['a9c6ae9e-f654-4ff4-84e3-88246e9351d4', 'ac7281a0-0159-4f5d-9e63-d4c62dc666c0', '667302c9-ba14-451e-96d0-12702c9ca212', 'e0474668-009d-4d56-9975-56702ba41961'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:11:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:11:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:11:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:40 devstack sudo[95692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:11:40 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:41 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-643997df-fbac-4ae0-adf2-18af35d91c3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae" returned: 0 in 0.794s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-643997df-fbac-4ae0-adf2-18af35d91c3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.761dfb17-94d6-4071-87d3-857abde2152b 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:41 devstack sudo[95694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.761dfb17-94d6-4071-87d3-857abde2152b 1G
Sep 28 18:11:41 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:41 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.325s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:41 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:11:41 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-1eb03234-f85b-48ed-b4de-42a6ab3fddf4 tempest-GroupSnapshotsTest-1942732534 None] Delete group completed successfully.
Sep 28 18:11:41 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-643997df-fbac-4ae0-adf2-18af35d91c3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.761dfb17-94d6-4071-87d3-857abde2152b 1G" returned: 0 in 0.677s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-643997df-fbac-4ae0-adf2-18af35d91c3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-700b722c-0c65-43d6-80d2-38902e022cae -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.761dfb17-94d6-4071-87d3-857abde2152b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:41 devstack sudo[95701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-700b722c-0c65-43d6-80d2-38902e022cae -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.761dfb17-94d6-4071-87d3-857abde2152b
Sep 28 18:11:41 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:42 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-16cf268a-3203-44db-8a27-7e46b3faa024 tempest-GroupSnapshotsTest-1942732534 None] Group tempest-GroupSnapshotsTest-Group-1273856679: creating
Sep 28 18:11:42 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-16cf268a-3203-44db-8a27-7e46b3faa024 tempest-GroupSnapshotsTest-1942732534 None] Group tempest-GroupSnapshotsTest-Group-1273856679: created successfully
Sep 28 18:11:42 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-16cf268a-3203-44db-8a27-7e46b3faa024 tempest-GroupSnapshotsTest-1942732534 None] Create group completed successfully.
Sep 28 18:11:42 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-643997df-fbac-4ae0-adf2-18af35d91c3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-700b722c-0c65-43d6-80d2-38902e022cae -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.761dfb17-94d6-4071-87d3-857abde2152b" returned: 0 in 0.545s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:42 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-643997df-fbac-4ae0-adf2-18af35d91c3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.761dfb17-94d6-4071-87d3-857abde2152b is being set with open permissions: ugo+rw
Sep 28 18:11:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-643997df-fbac-4ae0-adf2-18af35d91c3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.761dfb17-94d6-4071-87d3-857abde2152b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:42 devstack sudo[95710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.761dfb17-94d6-4071-87d3-857abde2152b
Sep 28 18:11:42 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:42 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-643997df-fbac-4ae0-adf2-18af35d91c3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.761dfb17-94d6-4071-87d3-857abde2152b" returned: 0 in 0.369s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-643997df-fbac-4ae0-adf2-18af35d91c3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:42 devstack sudo[95713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.info
Sep 28 18:11:42 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:43 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-643997df-fbac-4ae0-adf2-18af35d91c3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.info" returned: 0 in 0.501s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:43 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-643997df-fbac-4ae0-adf2-18af35d91c3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.info is being set with open permissions: ugo+rw
Sep 28 18:11:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-643997df-fbac-4ae0-adf2-18af35d91c3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:43 devstack sudo[95719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.info
Sep 28 18:11:43 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:43 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-bc08a3e8-3e10-4138-a074-b82a7ef558f6 req-805224dc-e91e-4bf2-81a7-709d750f22e5 tempest-AttachVolumeTestJSON-721645988 None] Terminate volume connection completed successfully.
Sep 28 18:11:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-bc08a3e8-3e10-4138-a074-b82a7ef558f6 req-805224dc-e91e-4bf2-81a7-709d750f22e5 tempest-AttachVolumeTestJSON-721645988 None] Deleting attachment 669befa2-ef30-469f-9649-18db9eb25b87. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:11:43 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-643997df-fbac-4ae0-adf2-18af35d91c3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.info" returned: 0 in 0.738s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-643997df-fbac-4ae0-adf2-18af35d91c3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.795s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:44 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-643997df-fbac-4ae0-adf2-18af35d91c3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Create snapshot completed successfully
Sep 28 18:11:44 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:11:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Flow 'volume_create_manager' (43304ca6-7207-44f0-beb4-91c2cdc000e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:11:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0be39a-9eda-4ff6-9b8c-f0ae3a734bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0be39a-9eda-4ff6-9b8c-f0ae3a734bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-891556368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1abe8275-eed6-47d1-a17d-381e6b43ddc6,host='devstack@QuobyteHD#QuobyteHD',id=30a0201b-e097-4c49-bba4-360b37b59d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e238fc908754b82be926348f117bde0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:44Z,use_quota=True,user_id='0063385e2ba347ccabc824cbb41c1d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(adcd9d5a-61f6-4b35-abaa-61a527ecad23),volume_type_id=adcd9d5a-61f6-4b35-abaa-61a527ecad23)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7150c41c-32a4-4d21-bf2b-5e45e1512baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7150c41c-32a4-4d21-bf2b-5e45e1512baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5739590a-e70c-433c-af43-93786cb6754b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5739590a-e70c-433c-af43-93786cb6754b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30a0201b-e097-4c49-bba4-360b37b59d9f', 'volume_name': 'volume-30a0201b-e097-4c49-bba4-360b37b59d9f', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266172b9-ae53-4ddf-b05f-24e58d3b776b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266172b9-ae53-4ddf-b05f-24e58d3b776b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b1012c-fbb8-4f3a-aba8-ba7a48ced343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:44 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Volume 30a0201b-e097-4c49-bba4-360b37b59d9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30a0201b-e097-4c49-bba4-360b37b59d9f', 'volume_size': 1}
Sep 28 18:11:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1abe8275-eed6-47d1-a17d-381e6b43ddc6,created_at=2026-09-28T16:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-891556368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1abe8275-eed6-47d1-a17d-381e6b43ddc6,host='devstack@QuobyteHD#QuobyteHD',id=30a0201b-e097-4c49-bba4-360b37b59d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e238fc908754b82be926348f117bde0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:44Z,use_quota=True,user_id='0063385e2ba347ccabc824cbb41c1d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(adcd9d5a-61f6-4b35-abaa-61a527ecad23),volume_type_id=adcd9d5a-61f6-4b35-abaa-61a527ecad23)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:11:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Creating volume 30a0201b-e097-4c49-bba4-360b37b59d9f {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:11:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:11:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:11:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:11:44 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:11:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:44 devstack sudo[95726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f 1073741824
Sep 28 18:11:44 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-59b5cc07-ebcd-425a-8b25-cb2b4944a105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Acquiring lock "cinder-761dfb17-94d6-4071-87d3-857abde2152b-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-59b5cc07-ebcd-425a-8b25-cb2b4944a105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Lock "cinder-761dfb17-94d6-4071-87d3-857abde2152b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-59b5cc07-ebcd-425a-8b25-cb2b4944a105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Acquiring lock "cinder-quobyte-700b722c-0c65-43d6-80d2-38902e022cae" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-59b5cc07-ebcd-425a-8b25-cb2b4944a105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Lock "cinder-quobyte-700b722c-0c65-43d6-80d2-38902e022cae" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-59b5cc07-ebcd-425a-8b25-cb2b4944a105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Acquiring lock "cinder-quobyte-761dfb17-94d6-4071-87d3-857abde2152b" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-59b5cc07-ebcd-425a-8b25-cb2b4944a105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Lock "cinder-quobyte-761dfb17-94d6-4071-87d3-857abde2152b" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-59b5cc07-ebcd-425a-8b25-cb2b4944a105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Deleting offline snapshot 761dfb17-94d6-4071-87d3-857abde2152b of volume 700b722c-0c65-43d6-80d2-38902e022cae {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:11:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-59b5cc07-ebcd-425a-8b25-cb2b4944a105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] snapshot_file for this snap is: volume-700b722c-0c65-43d6-80d2-38902e022cae.761dfb17-94d6-4071-87d3-857abde2152b {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:11:45 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[125cfbf1-d1e7-444e-9a0e-8ae9d3bcc5b7]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-59b5cc07-ebcd-425a-8b25-cb2b4944a105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.761dfb17-94d6-4071-87d3-857abde2152b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:45 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f 1073741824" returned: 0 in 0.860s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:45 devstack sudo[95738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f
Sep 28 18:11:45 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:45 devstack sudo[95736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.761dfb17-94d6-4071-87d3-857abde2152b
Sep 28 18:11:45 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:45 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-04c099c0-c39b-4db6-960a-ee2c9f49a36e req-d1540469-c5a9-42f0-b83b-1fca89b5c6ee tempest-AttachVolumeTestJSON-721645988 None] Terminate volume connection completed successfully.
Sep 28 18:11:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-04c099c0-c39b-4db6-960a-ee2c9f49a36e req-d1540469-c5a9-42f0-b83b-1fca89b5c6ee tempest-AttachVolumeTestJSON-721645988 None] Deleting attachment 1c4b55eb-39b1-4cb4-9c08-7cce282cf822. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:11:46 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f" returned: 0 in 0.457s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:11:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b1012c-fbb8-4f3a-aba8-ba7a48ced343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30a0201b-e097-4c49-bba4-360b37b59d9f', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b5ccce-bed2-4bf5-954d-ebe3534e6b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:11:46 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Volume volume-30a0201b-e097-4c49-bba4-360b37b59d9f (30a0201b-e097-4c49-bba4-360b37b59d9f): created successfully
Sep 28 18:11:46 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b5ccce-bed2-4bf5-954d-ebe3534e6b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:11:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Flow 'volume_create_manager' (43304ca6-7207-44f0-beb4-91c2cdc000e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:11:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-59b5cc07-ebcd-425a-8b25-cb2b4944a105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.761dfb17-94d6-4071-87d3-857abde2152b" returned: 0 in 0.620s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-59b5cc07-ebcd-425a-8b25-cb2b4944a105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-700b722c-0c65-43d6-80d2-38902e022cae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:11:46 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-1cb15c67-e9b9-4644-b225-d3931d3e347f tempest-GroupSnapshotsTest-1942732534 None] Created volume successfully.
Sep 28 18:11:46 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecdda9e-9600-4f1c-ad58-a2420a16cff1]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-59b5cc07-ebcd-425a-8b25-cb2b4944a105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:46 devstack sudo[95771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae
Sep 28 18:11:46 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:46 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-59b5cc07-ebcd-425a-8b25-cb2b4944a105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae" returned: 0 in 0.508s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-59b5cc07-ebcd-425a-8b25-cb2b4944a105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.761dfb17-94d6-4071-87d3-857abde2152b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:46 devstack sudo[95776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.761dfb17-94d6-4071-87d3-857abde2152b
Sep 28 18:11:46 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:47 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-59b5cc07-ebcd-425a-8b25-cb2b4944a105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.761dfb17-94d6-4071-87d3-857abde2152b" returned: 0 in 0.676s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-59b5cc07-ebcd-425a-8b25-cb2b4944a105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.761dfb17-94d6-4071-87d3-857abde2152b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:47 devstack sudo[95787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.761dfb17-94d6-4071-87d3-857abde2152b
Sep 28 18:11:47 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:47 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-fe514a98-23cb-4c3c-a93a-8e05876a5cd6 tempest-GroupSnapshotsTest-1942732534 None] GroupSnapshot 742bcd5e-cb41-4771-93f9-d665d208b13a: creating.
Sep 28 18:11:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-fe514a98-23cb-4c3c-a93a-8e05876a5cd6 tempest-GroupSnapshotsTest-1942732534 None] Group snapshot 742bcd5e-cb41-4771-93f9-d665d208b13a: creating. {{(pid=87046) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 28 18:11:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-fe514a98-23cb-4c3c-a93a-8e05876a5cd6 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-fe514a98-23cb-4c3c-a93a-8e05876a5cd6 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-fe514a98-23cb-4c3c-a93a-8e05876a5cd6 tempest-GroupSnapshotsTest-1942732534 None] Creating offline snapshot 646f2ef9-32bd-4024-af1c-71fc6979b6d1 of volume 30a0201b-e097-4c49-bba4-360b37b59d9f {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:11:48 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d46696-4c9d-4957-86fb-080e94ce6d75]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fe514a98-23cb-4c3c-a93a-8e05876a5cd6 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:48 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-59b5cc07-ebcd-425a-8b25-cb2b4944a105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae.761dfb17-94d6-4071-87d3-857abde2152b" returned: 0 in 0.697s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-59b5cc07-ebcd-425a-8b25-cb2b4944a105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Lock "cinder-quobyte-761dfb17-94d6-4071-87d3-857abde2152b" released by "_delete_snapshot" :: held 2.733s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-59b5cc07-ebcd-425a-8b25-cb2b4944a105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Lock "cinder-quobyte-700b722c-0c65-43d6-80d2-38902e022cae" released by "delete_snapshot" :: held 2.781s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:48 devstack sudo[95807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f
Sep 28 18:11:48 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:48 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-59b5cc07-ebcd-425a-8b25-cb2b4944a105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Created reservations ['ffdee361-6853-4276-bb80-e8b1d6c320a9', 'ec36719b-4300-48a5-95dd-1ef9891b7ed3', 'a3ee85a8-681c-49f8-9a02-4de2486cbdd1', 'aa79524c-a426-4fe2-b169-7d355e86e9f0'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:11:48 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-59b5cc07-ebcd-425a-8b25-cb2b4944a105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Delete snapshot completed successfully.
Sep 28 18:11:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-59b5cc07-ebcd-425a-8b25-cb2b4944a105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Lock "cinder-761dfb17-94d6-4071-87d3-857abde2152b-delete_snapshot" released by "delete_snapshot" :: held 3.074s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7ded62d2-05d7-41c1-a96c-9b1a02e20df3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Acquiring lock "cinder-700b722c-0c65-43d6-80d2-38902e022cae-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7ded62d2-05d7-41c1-a96c-9b1a02e20df3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Lock "cinder-700b722c-0c65-43d6-80d2-38902e022cae-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:48 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fe514a98-23cb-4c3c-a93a-8e05876a5cd6 tempest-GroupSnapshotsTest-1942732534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f" returned: 0 in 0.826s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fe514a98-23cb-4c3c-a93a-8e05876a5cd6 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.646f2ef9-32bd-4024-af1c-71fc6979b6d1 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:48 devstack sudo[95816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.646f2ef9-32bd-4024-af1c-71fc6979b6d1 1G
Sep 28 18:11:48 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7ded62d2-05d7-41c1-a96c-9b1a02e20df3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Acquiring lock "cinder-quobyte-700b722c-0c65-43d6-80d2-38902e022cae" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7ded62d2-05d7-41c1-a96c-9b1a02e20df3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Lock "cinder-quobyte-700b722c-0c65-43d6-80d2-38902e022cae" acquired by "delete_volume" :: waited 0.028s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:49 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dd770c-e9ee-46c1-8b06-6516432e560b]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7ded62d2-05d7-41c1-a96c-9b1a02e20df3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:49 devstack sudo[95818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae
Sep 28 18:11:49 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:49 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fe514a98-23cb-4c3c-a93a-8e05876a5cd6 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.646f2ef9-32bd-4024-af1c-71fc6979b6d1 1G" returned: 0 in 0.762s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fe514a98-23cb-4c3c-a93a-8e05876a5cd6 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30a0201b-e097-4c49-bba4-360b37b59d9f -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.646f2ef9-32bd-4024-af1c-71fc6979b6d1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:49 devstack sudo[95828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30a0201b-e097-4c49-bba4-360b37b59d9f -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.646f2ef9-32bd-4024-af1c-71fc6979b6d1
Sep 28 18:11:49 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:49 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7ded62d2-05d7-41c1-a96c-9b1a02e20df3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae" returned: 0 in 0.647s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7ded62d2-05d7-41c1-a96c-9b1a02e20df3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:49 devstack sudo[95831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae
Sep 28 18:11:49 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:49 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fe514a98-23cb-4c3c-a93a-8e05876a5cd6 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30a0201b-e097-4c49-bba4-360b37b59d9f -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.646f2ef9-32bd-4024-af1c-71fc6979b6d1" returned: 0 in 0.355s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:49 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-fe514a98-23cb-4c3c-a93a-8e05876a5cd6 tempest-GroupSnapshotsTest-1942732534 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.646f2ef9-32bd-4024-af1c-71fc6979b6d1 is being set with open permissions: ugo+rw: NotImplementedError
Sep 28 18:11:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fe514a98-23cb-4c3c-a93a-8e05876a5cd6 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.646f2ef9-32bd-4024-af1c-71fc6979b6d1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:50 devstack sudo[95836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.646f2ef9-32bd-4024-af1c-71fc6979b6d1
Sep 28 18:11:50 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:50 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7ded62d2-05d7-41c1-a96c-9b1a02e20df3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-700b722c-0c65-43d6-80d2-38902e022cae" returned: 0 in 0.395s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:50 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7ded62d2-05d7-41c1-a96c-9b1a02e20df3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Lock "cinder-quobyte-700b722c-0c65-43d6-80d2-38902e022cae" released by "delete_volume" :: held 1.177s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:50 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-7ded62d2-05d7-41c1-a96c-9b1a02e20df3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Created reservations ['24c849e2-b49c-44d7-abb2-083d3a2ba367', 'f5eb58bc-e818-4dff-8e0a-9fe19c9d812f', '55873b1b-2f3b-489d-82a6-49485894d82f', '4f655b6b-8a6e-4f4d-af26-989302a61d22'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:11:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7ded62d2-05d7-41c1-a96c-9b1a02e20df3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7ded62d2-05d7-41c1-a96c-9b1a02e20df3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7ded62d2-05d7-41c1-a96c-9b1a02e20df3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:11:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7ded62d2-05d7-41c1-a96c-9b1a02e20df3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:11:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7ded62d2-05d7-41c1-a96c-9b1a02e20df3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7ded62d2-05d7-41c1-a96c-9b1a02e20df3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:50 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fe514a98-23cb-4c3c-a93a-8e05876a5cd6 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.646f2ef9-32bd-4024-af1c-71fc6979b6d1" returned: 0 in 0.399s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:50 devstack sudo[95840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:11:50 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fe514a98-23cb-4c3c-a93a-8e05876a5cd6 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:50 devstack sudo[95842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.info
Sep 28 18:11:50 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:50 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7ded62d2-05d7-41c1-a96c-9b1a02e20df3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.393s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:50 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-7ded62d2-05d7-41c1-a96c-9b1a02e20df3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:11:50 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-7ded62d2-05d7-41c1-a96c-9b1a02e20df3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Deleted volume successfully.
Sep 28 18:11:50 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7ded62d2-05d7-41c1-a96c-9b1a02e20df3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1061206667 None] Lock "cinder-700b722c-0c65-43d6-80d2-38902e022cae-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:50 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fe514a98-23cb-4c3c-a93a-8e05876a5cd6 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.info" returned: 0 in 0.451s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:50 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-fe514a98-23cb-4c3c-a93a-8e05876a5cd6 tempest-GroupSnapshotsTest-1942732534 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 28 18:11:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fe514a98-23cb-4c3c-a93a-8e05876a5cd6 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:50 devstack sudo[95846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.info
Sep 28 18:11:50 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:51 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fe514a98-23cb-4c3c-a93a-8e05876a5cd6 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.info" returned: 0 in 0.453s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-fe514a98-23cb-4c3c-a93a-8e05876a5cd6 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.436s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:51 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-fe514a98-23cb-4c3c-a93a-8e05876a5cd6 tempest-GroupSnapshotsTest-1942732534 None] group_snapshot 742bcd5e-cb41-4771-93f9-d665d208b13a: created successfully
Sep 28 18:11:52 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] group_snapshot 742bcd5e-cb41-4771-93f9-d665d208b13a: deleting
Sep 28 18:11:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] group_snapshot 742bcd5e-cb41-4771-93f9-d665d208b13a: deleting {{(pid=87046) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 28 18:11:52 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "cinder-quobyte-30a0201b-e097-4c49-bba4-360b37b59d9f" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:52 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-30a0201b-e097-4c49-bba4-360b37b59d9f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:52 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "cinder-quobyte-646f2ef9-32bd-4024-af1c-71fc6979b6d1" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:52 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-646f2ef9-32bd-4024-af1c-71fc6979b6d1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:52 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] Deleting offline snapshot 646f2ef9-32bd-4024-af1c-71fc6979b6d1 of volume 30a0201b-e097-4c49-bba4-360b37b59d9f {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:11:52 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] snapshot_file for this snap is: volume-30a0201b-e097-4c49-bba4-360b37b59d9f.646f2ef9-32bd-4024-af1c-71fc6979b6d1 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:11:52 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb92181-ae5b-45f0-9857-08e9d31b6e00]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.646f2ef9-32bd-4024-af1c-71fc6979b6d1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:53 devstack sudo[95851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.646f2ef9-32bd-4024-af1c-71fc6979b6d1
Sep 28 18:11:53 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:53 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.646f2ef9-32bd-4024-af1c-71fc6979b6d1" returned: 0 in 0.747s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30a0201b-e097-4c49-bba4-360b37b59d9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:11:53 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80e01b9-e657-474f-92b3-b2c71584990f]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:53 devstack sudo[95856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f
Sep 28 18:11:53 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:54 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f" returned: 0 in 0.581s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.646f2ef9-32bd-4024-af1c-71fc6979b6d1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:54 devstack sudo[95861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.646f2ef9-32bd-4024-af1c-71fc6979b6d1
Sep 28 18:11:54 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:54 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.646f2ef9-32bd-4024-af1c-71fc6979b6d1" returned: 0 in 0.436s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.646f2ef9-32bd-4024-af1c-71fc6979b6d1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:54 devstack sudo[95867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.646f2ef9-32bd-4024-af1c-71fc6979b6d1
Sep 28 18:11:54 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:55 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a609941f-edee-4f5a-85a8-e3eb7db4b3d0 tempest-AttachVolumeTestJSON-721645988 None] Acquiring lock "cinder-f76b505d-e120-4645-8396-dccc4a717b79-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:55 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a609941f-edee-4f5a-85a8-e3eb7db4b3d0 tempest-AttachVolumeTestJSON-721645988 None] Lock "cinder-f76b505d-e120-4645-8396-dccc4a717b79-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:55 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a609941f-edee-4f5a-85a8-e3eb7db4b3d0 tempest-AttachVolumeTestJSON-721645988 None] Acquiring lock "cinder-quobyte-f76b505d-e120-4645-8396-dccc4a717b79" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:55 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a609941f-edee-4f5a-85a8-e3eb7db4b3d0 tempest-AttachVolumeTestJSON-721645988 None] Lock "cinder-quobyte-f76b505d-e120-4645-8396-dccc4a717b79" acquired by "delete_volume" :: waited 0.044s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:55 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f.646f2ef9-32bd-4024-af1c-71fc6979b6d1" returned: 0 in 0.554s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:55 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[92226ae7-4d43-4198-92b3-fd4760102d88]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a609941f-edee-4f5a-85a8-e3eb7db4b3d0 tempest-AttachVolumeTestJSON-721645988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f76b505d-e120-4645-8396-dccc4a717b79 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:55 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-646f2ef9-32bd-4024-af1c-71fc6979b6d1" released by "_delete_snapshot" :: held 2.545s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:55 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-30a0201b-e097-4c49-bba4-360b37b59d9f" released by "delete_snapshot" :: held 2.582s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:55 devstack cinder-volume[87046]: WARNING cinder.quota [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-556187529 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-556187529, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:11:55 devstack cinder-volume[87046]: WARNING cinder.quota [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-556187529 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-556187529, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:11:55 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] Created reservations ['bd2cdd86-f4c0-46e0-b312-ea27f7220a0d', '56a76a49-c8df-4fa6-a78c-594e11930ad5', 'a223140f-04c6-4115-a41e-9f93bf0ecbfc', '0e15d14f-000a-4b28-9a44-c1ea6e8eca85'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:11:55 devstack sudo[95870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f76b505d-e120-4645-8396-dccc4a717b79
Sep 28 18:11:55 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:55 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-fbea6d87-b576-44b0-8c6d-7c27048ca474 tempest-GroupSnapshotsTest-1942732534 None] group_snapshot 742bcd5e-cb41-4771-93f9-d665d208b13a: deleted successfully
Sep 28 18:11:55 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a609941f-edee-4f5a-85a8-e3eb7db4b3d0 tempest-AttachVolumeTestJSON-721645988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f76b505d-e120-4645-8396-dccc4a717b79" returned: 0 in 0.680s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a609941f-edee-4f5a-85a8-e3eb7db4b3d0 tempest-AttachVolumeTestJSON-721645988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f76b505d-e120-4645-8396-dccc4a717b79 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:55 devstack sudo[95875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f76b505d-e120-4645-8396-dccc4a717b79
Sep 28 18:11:55 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:56 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a609941f-edee-4f5a-85a8-e3eb7db4b3d0 tempest-AttachVolumeTestJSON-721645988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f76b505d-e120-4645-8396-dccc4a717b79" returned: 0 in 0.429s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a609941f-edee-4f5a-85a8-e3eb7db4b3d0 tempest-AttachVolumeTestJSON-721645988 None] Lock "cinder-quobyte-f76b505d-e120-4645-8396-dccc4a717b79" released by "delete_volume" :: held 1.228s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:56 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-a609941f-edee-4f5a-85a8-e3eb7db4b3d0 tempest-AttachVolumeTestJSON-721645988 None] Created reservations ['8dffa4a0-25aa-40b1-8775-67a0b1cd8baf', 'e2f0a5c0-d370-4014-b676-292fe82e0d60', '4af9178b-9894-40e8-b385-e77bfbb99070', '6fbc5f56-a128-45e2-962e-00d88c7cc997'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:11:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a609941f-edee-4f5a-85a8-e3eb7db4b3d0 tempest-AttachVolumeTestJSON-721645988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a609941f-edee-4f5a-85a8-e3eb7db4b3d0 tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a609941f-edee-4f5a-85a8-e3eb7db4b3d0 tempest-AttachVolumeTestJSON-721645988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:11:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a609941f-edee-4f5a-85a8-e3eb7db4b3d0 tempest-AttachVolumeTestJSON-721645988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:11:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a609941f-edee-4f5a-85a8-e3eb7db4b3d0 tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a609941f-edee-4f5a-85a8-e3eb7db4b3d0 tempest-AttachVolumeTestJSON-721645988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:56 devstack sudo[95878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:11:56 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f553dded-1e94-4dc8-89d0-7da8be1d40f9 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "cinder-quobyte-30a0201b-e097-4c49-bba4-360b37b59d9f" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f553dded-1e94-4dc8-89d0-7da8be1d40f9 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-30a0201b-e097-4c49-bba4-360b37b59d9f" acquired by "delete_volume" :: waited 0.023s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:56 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f804c18-76e7-4443-a794-0683c42ebf6e]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f553dded-1e94-4dc8-89d0-7da8be1d40f9 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:57 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a609941f-edee-4f5a-85a8-e3eb7db4b3d0 tempest-AttachVolumeTestJSON-721645988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.417s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:57 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-a609941f-edee-4f5a-85a8-e3eb7db4b3d0 tempest-AttachVolumeTestJSON-721645988 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:11:57 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-a609941f-edee-4f5a-85a8-e3eb7db4b3d0 tempest-AttachVolumeTestJSON-721645988 None] Deleted volume successfully.
Sep 28 18:11:57 devstack sudo[95880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f
Sep 28 18:11:57 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a609941f-edee-4f5a-85a8-e3eb7db4b3d0 tempest-AttachVolumeTestJSON-721645988 None] Lock "cinder-f76b505d-e120-4645-8396-dccc4a717b79-delete_volume" released by "delete_volume" :: held 2.144s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-dcbfc633-6c2c-4511-a39e-860983b1ad97 tempest-AttachVolumeTestJSON-721645988 None] Acquiring lock "cinder-4617f551-20b9-4bed-bdb6-5758c1c47441-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-dcbfc633-6c2c-4511-a39e-860983b1ad97 tempest-AttachVolumeTestJSON-721645988 None] Lock "cinder-4617f551-20b9-4bed-bdb6-5758c1c47441-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-dcbfc633-6c2c-4511-a39e-860983b1ad97 tempest-AttachVolumeTestJSON-721645988 None] Acquiring lock "cinder-quobyte-4617f551-20b9-4bed-bdb6-5758c1c47441" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:11:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-dcbfc633-6c2c-4511-a39e-860983b1ad97 tempest-AttachVolumeTestJSON-721645988 None] Lock "cinder-quobyte-4617f551-20b9-4bed-bdb6-5758c1c47441" acquired by "delete_volume" :: waited 0.033s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:11:57 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f553dded-1e94-4dc8-89d0-7da8be1d40f9 tempest-GroupSnapshotsTest-1942732534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f" returned: 0 in 0.659s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f553dded-1e94-4dc8-89d0-7da8be1d40f9 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:57 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c66df5-2cee-4dda-80a2-56a70ae11f70]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:11:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dcbfc633-6c2c-4511-a39e-860983b1ad97 tempest-AttachVolumeTestJSON-721645988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4617f551-20b9-4bed-bdb6-5758c1c47441 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:57 devstack sudo[95886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f
Sep 28 18:11:57 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:57 devstack sudo[95887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4617f551-20b9-4bed-bdb6-5758c1c47441
Sep 28 18:11:57 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:57 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f553dded-1e94-4dc8-89d0-7da8be1d40f9 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-30a0201b-e097-4c49-bba4-360b37b59d9f" returned: 0 in 0.339s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f553dded-1e94-4dc8-89d0-7da8be1d40f9 tempest-GroupSnapshotsTest-1942732534 None] Lock "cinder-quobyte-30a0201b-e097-4c49-bba4-360b37b59d9f" released by "delete_volume" :: held 1.100s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:58 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-f553dded-1e94-4dc8-89d0-7da8be1d40f9 tempest-GroupSnapshotsTest-1942732534 None] Created reservations ['d14a6a49-f261-4e27-80a2-29bdddf8739d'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:11:58 devstack cinder-volume[87046]: WARNING cinder.quota [None req-f553dded-1e94-4dc8-89d0-7da8be1d40f9 tempest-GroupSnapshotsTest-1942732534 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-556187529 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-556187529, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:11:58 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-f553dded-1e94-4dc8-89d0-7da8be1d40f9 tempest-GroupSnapshotsTest-1942732534 None] Created reservations ['e4255895-1ab4-4b06-b1d3-a21fdbad3dfd', '34435997-0697-4555-a417-dac74ad2f6e2', 'e8460294-32bb-4df3-a073-5d51ad48b99c', '186c2b6f-8879-4fef-ba81-fc9f858f7a4f'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:11:58 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dcbfc633-6c2c-4511-a39e-860983b1ad97 tempest-AttachVolumeTestJSON-721645988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4617f551-20b9-4bed-bdb6-5758c1c47441" returned: 0 in 0.695s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dcbfc633-6c2c-4511-a39e-860983b1ad97 tempest-AttachVolumeTestJSON-721645988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4617f551-20b9-4bed-bdb6-5758c1c47441 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:58 devstack sudo[95894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4617f551-20b9-4bed-bdb6-5758c1c47441
Sep 28 18:11:58 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f553dded-1e94-4dc8-89d0-7da8be1d40f9 tempest-GroupSnapshotsTest-1942732534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f553dded-1e94-4dc8-89d0-7da8be1d40f9 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f553dded-1e94-4dc8-89d0-7da8be1d40f9 tempest-GroupSnapshotsTest-1942732534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:11:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f553dded-1e94-4dc8-89d0-7da8be1d40f9 tempest-GroupSnapshotsTest-1942732534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:11:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f553dded-1e94-4dc8-89d0-7da8be1d40f9 tempest-GroupSnapshotsTest-1942732534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f553dded-1e94-4dc8-89d0-7da8be1d40f9 tempest-GroupSnapshotsTest-1942732534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:58 devstack sudo[95896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:11:58 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:58 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dcbfc633-6c2c-4511-a39e-860983b1ad97 tempest-AttachVolumeTestJSON-721645988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4617f551-20b9-4bed-bdb6-5758c1c47441" returned: 0 in 0.388s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-dcbfc633-6c2c-4511-a39e-860983b1ad97 tempest-AttachVolumeTestJSON-721645988 None] Lock "cinder-quobyte-4617f551-20b9-4bed-bdb6-5758c1c47441" released by "delete_volume" :: held 1.164s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:11:58 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f553dded-1e94-4dc8-89d0-7da8be1d40f9 tempest-GroupSnapshotsTest-1942732534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.411s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:58 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-f553dded-1e94-4dc8-89d0-7da8be1d40f9 tempest-GroupSnapshotsTest-1942732534 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:11:58 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-f553dded-1e94-4dc8-89d0-7da8be1d40f9 tempest-GroupSnapshotsTest-1942732534 None] Delete group completed successfully.
Sep 28 18:11:58 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-dcbfc633-6c2c-4511-a39e-860983b1ad97 tempest-AttachVolumeTestJSON-721645988 None] Created reservations ['5a2ad547-144a-41f3-95a4-b0fdeb718608', 'dc55f532-cb6d-47e1-a6de-79ca3e157b06', 'acf6bfeb-86c5-4527-868d-d82375550d56', 'f25a8fe3-b8c9-45cf-b468-08ab2fe7b8d3'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:11:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-dcbfc633-6c2c-4511-a39e-860983b1ad97 tempest-AttachVolumeTestJSON-721645988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:11:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-dcbfc633-6c2c-4511-a39e-860983b1ad97 tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:11:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-dcbfc633-6c2c-4511-a39e-860983b1ad97 tempest-AttachVolumeTestJSON-721645988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:11:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-dcbfc633-6c2c-4511-a39e-860983b1ad97 tempest-AttachVolumeTestJSON-721645988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:11:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-dcbfc633-6c2c-4511-a39e-860983b1ad97 tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:11:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dcbfc633-6c2c-4511-a39e-860983b1ad97 tempest-AttachVolumeTestJSON-721645988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:11:59 devstack sudo[95900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:11:59 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:11:59 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root
Sep 28 18:11:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dcbfc633-6c2c-4511-a39e-860983b1ad97 tempest-AttachVolumeTestJSON-721645988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.393s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:11:59 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-dcbfc633-6c2c-4511-a39e-860983b1ad97 tempest-AttachVolumeTestJSON-721645988 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:11:59 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-dcbfc633-6c2c-4511-a39e-860983b1ad97 tempest-AttachVolumeTestJSON-721645988 None] Deleted volume successfully.
Sep 28 18:11:59 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-dcbfc633-6c2c-4511-a39e-860983b1ad97 tempest-AttachVolumeTestJSON-721645988 None] Lock "cinder-4617f551-20b9-4bed-bdb6-5758c1c47441-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:12:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1a5cd30f-4e5b-4e85-9a4a-c37e32be8508 tempest-AttachVolumeTestJSON-721645988 None] Acquiring lock "cinder-a3187d71-42d1-4c53-984f-bb5aa6d33da9-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:12:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1a5cd30f-4e5b-4e85-9a4a-c37e32be8508 tempest-AttachVolumeTestJSON-721645988 None] Lock "cinder-a3187d71-42d1-4c53-984f-bb5aa6d33da9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:12:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1a5cd30f-4e5b-4e85-9a4a-c37e32be8508 tempest-AttachVolumeTestJSON-721645988 None] Acquiring lock "cinder-quobyte-a3187d71-42d1-4c53-984f-bb5aa6d33da9" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:12:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1a5cd30f-4e5b-4e85-9a4a-c37e32be8508 tempest-AttachVolumeTestJSON-721645988 None] Lock "cinder-quobyte-a3187d71-42d1-4c53-984f-bb5aa6d33da9" acquired by "delete_volume" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:12:00 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aabb826-2c34-4332-bbd4-05b30eda89fb]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:12:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1a5cd30f-4e5b-4e85-9a4a-c37e32be8508 tempest-AttachVolumeTestJSON-721645988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a3187d71-42d1-4c53-984f-bb5aa6d33da9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:00 devstack sudo[95911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a3187d71-42d1-4c53-984f-bb5aa6d33da9
Sep 28 18:12:00 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:00 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1a5cd30f-4e5b-4e85-9a4a-c37e32be8508 tempest-AttachVolumeTestJSON-721645988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a3187d71-42d1-4c53-984f-bb5aa6d33da9" returned: 0 in 0.550s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1a5cd30f-4e5b-4e85-9a4a-c37e32be8508 tempest-AttachVolumeTestJSON-721645988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a3187d71-42d1-4c53-984f-bb5aa6d33da9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:00 devstack sudo[95916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a3187d71-42d1-4c53-984f-bb5aa6d33da9
Sep 28 18:12:00 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:01 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1a5cd30f-4e5b-4e85-9a4a-c37e32be8508 tempest-AttachVolumeTestJSON-721645988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a3187d71-42d1-4c53-984f-bb5aa6d33da9" returned: 0 in 0.309s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1a5cd30f-4e5b-4e85-9a4a-c37e32be8508 tempest-AttachVolumeTestJSON-721645988 None] Lock "cinder-quobyte-a3187d71-42d1-4c53-984f-bb5aa6d33da9" released by "delete_volume" :: held 0.963s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:12:01 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-1a5cd30f-4e5b-4e85-9a4a-c37e32be8508 tempest-AttachVolumeTestJSON-721645988 None] Created reservations ['f5d5affe-4651-4cf1-9c49-a33fd1b69d08', 'c1f2048d-a508-4238-b1ca-606677c731d0', '9c11bf0a-e6eb-4353-9657-83e2ca432cae', 'b001188d-1d99-4bbb-9e48-3311abf6b6ee'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:12:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1a5cd30f-4e5b-4e85-9a4a-c37e32be8508 tempest-AttachVolumeTestJSON-721645988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:12:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1a5cd30f-4e5b-4e85-9a4a-c37e32be8508 tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:12:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1a5cd30f-4e5b-4e85-9a4a-c37e32be8508 tempest-AttachVolumeTestJSON-721645988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:12:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1a5cd30f-4e5b-4e85-9a4a-c37e32be8508 tempest-AttachVolumeTestJSON-721645988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:12:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1a5cd30f-4e5b-4e85-9a4a-c37e32be8508 tempest-AttachVolumeTestJSON-721645988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:12:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1a5cd30f-4e5b-4e85-9a4a-c37e32be8508 tempest-AttachVolumeTestJSON-721645988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:01 devstack sudo[95919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:12:01 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:01 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1a5cd30f-4e5b-4e85-9a4a-c37e32be8508 tempest-AttachVolumeTestJSON-721645988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.409s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:01 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-1a5cd30f-4e5b-4e85-9a4a-c37e32be8508 tempest-AttachVolumeTestJSON-721645988 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:12:01 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-1a5cd30f-4e5b-4e85-9a4a-c37e32be8508 tempest-AttachVolumeTestJSON-721645988 None] Deleted volume successfully.
Sep 28 18:12:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1a5cd30f-4e5b-4e85-9a4a-c37e32be8508 tempest-AttachVolumeTestJSON-721645988 None] Lock "cinder-a3187d71-42d1-4c53-984f-bb5aa6d33da9-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:12:03 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:12:03 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Flow 'volume_create_manager' (240f2ad8-7858-4ee0-9e79-0a0e4b88f9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:12:03 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14149512-c710-4254-97f3-89dd7dfa4ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:03 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14149512-c710-4254-97f3-89dd7dfa4ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-559454254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5603a58-c156-4ace-a6c4-aa1f905b8835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba62788bceaf49f38bbfadb7a2969bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:04Z,use_quota=True,user_id='792c436e88824ab0a1677bf1bfa2ff05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9e1c3b9-dfde-4be0-aa49-9eddd4d00b5d),volume_type_id=e9e1c3b9-dfde-4be0-aa49-9eddd4d00b5d)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:03 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f24e10d-b03a-47d1-952d-95ee119bbfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:03 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f24e10d-b03a-47d1-952d-95ee119bbfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:03 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ce8aac-03f9-4029-a24b-a080dd7e5496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:03 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ce8aac-03f9-4029-a24b-a080dd7e5496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5603a58-c156-4ace-a6c4-aa1f905b8835', 'volume_name': 'volume-e5603a58-c156-4ace-a6c4-aa1f905b8835', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:03 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce200112-4265-4395-bd60-e09f1a0bc601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:03 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce200112-4265-4395-bd60-e09f1a0bc601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:03 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b534112-ffa2-4a28-a846-e153857a4a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:03 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Volume e5603a58-c156-4ace-a6c4-aa1f905b8835: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5603a58-c156-4ace-a6c4-aa1f905b8835', 'volume_size': 1}
Sep 28 18:12:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:12:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:12:03 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-559454254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5603a58-c156-4ace-a6c4-aa1f905b8835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba62788bceaf49f38bbfadb7a2969bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:04Z,use_quota=True,user_id='792c436e88824ab0a1677bf1bfa2ff05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9e1c3b9-dfde-4be0-aa49-9eddd4d00b5d),volume_type_id=e9e1c3b9-dfde-4be0-aa49-9eddd4d00b5d)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:12:03 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Creating volume e5603a58-c156-4ace-a6c4-aa1f905b8835 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:12:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:12:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:12:03 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:12:03 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:12:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:12:03 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:12:03 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:12:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e5603a58-c156-4ace-a6c4-aa1f905b8835 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:03 devstack sudo[95923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e5603a58-c156-4ace-a6c4-aa1f905b8835 1073741824
Sep 28 18:12:03 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:04 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e5603a58-c156-4ace-a6c4-aa1f905b8835 1073741824" returned: 0 in 0.685s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e5603a58-c156-4ace-a6c4-aa1f905b8835 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:04 devstack sudo[95929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e5603a58-c156-4ace-a6c4-aa1f905b8835
Sep 28 18:12:04 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:04 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e5603a58-c156-4ace-a6c4-aa1f905b8835" returned: 0 in 0.399s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:04 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:12:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:12:04 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b534112-ffa2-4a28-a846-e153857a4a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5603a58-c156-4ace-a6c4-aa1f905b8835', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:04 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (433dbb14-7860-4303-baf9-d5f7fbb96e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:04 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Volume volume-e5603a58-c156-4ace-a6c4-aa1f905b8835 (e5603a58-c156-4ace-a6c4-aa1f905b8835): created successfully
Sep 28 18:12:04 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (433dbb14-7860-4303-baf9-d5f7fbb96e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:04 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Flow 'volume_create_manager' (240f2ad8-7858-4ee0-9e79-0a0e4b88f9ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:12:05 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-0cbcfb1b-e434-4923-987d-4d15e4298ff0 tempest-VolumeTypesAccessTest-1333911508 None] Created volume successfully.
Sep 28 18:12:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-99eb8345-b8cb-40ea-8cc2-87565afbb03b tempest-VolumeTypesAccessTest-1333911508 None] Acquiring lock "cinder-e5603a58-c156-4ace-a6c4-aa1f905b8835-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:12:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-99eb8345-b8cb-40ea-8cc2-87565afbb03b tempest-VolumeTypesAccessTest-1333911508 None] Lock "cinder-e5603a58-c156-4ace-a6c4-aa1f905b8835-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:12:06 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-99eb8345-b8cb-40ea-8cc2-87565afbb03b tempest-VolumeTypesAccessTest-1333911508 None] Acquiring lock "cinder-quobyte-e5603a58-c156-4ace-a6c4-aa1f905b8835" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:12:06 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-99eb8345-b8cb-40ea-8cc2-87565afbb03b tempest-VolumeTypesAccessTest-1333911508 None] Lock "cinder-quobyte-e5603a58-c156-4ace-a6c4-aa1f905b8835" acquired by "delete_volume" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:12:06 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac9f026-083e-49cf-9f24-cc1537d939cb]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:12:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-99eb8345-b8cb-40ea-8cc2-87565afbb03b tempest-VolumeTypesAccessTest-1333911508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e5603a58-c156-4ace-a6c4-aa1f905b8835 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:06 devstack sudo[95932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e5603a58-c156-4ace-a6c4-aa1f905b8835
Sep 28 18:12:06 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:06 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-99eb8345-b8cb-40ea-8cc2-87565afbb03b tempest-VolumeTypesAccessTest-1333911508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e5603a58-c156-4ace-a6c4-aa1f905b8835" returned: 0 in 0.643s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-99eb8345-b8cb-40ea-8cc2-87565afbb03b tempest-VolumeTypesAccessTest-1333911508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e5603a58-c156-4ace-a6c4-aa1f905b8835 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:06 devstack sudo[95937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e5603a58-c156-4ace-a6c4-aa1f905b8835
Sep 28 18:12:06 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:07 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-99eb8345-b8cb-40ea-8cc2-87565afbb03b tempest-VolumeTypesAccessTest-1333911508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e5603a58-c156-4ace-a6c4-aa1f905b8835" returned: 0 in 0.363s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-99eb8345-b8cb-40ea-8cc2-87565afbb03b tempest-VolumeTypesAccessTest-1333911508 None] Lock "cinder-quobyte-e5603a58-c156-4ace-a6c4-aa1f905b8835" released by "delete_volume" :: held 1.084s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:12:07 devstack cinder-volume[87046]: WARNING cinder.quota [None req-99eb8345-b8cb-40ea-8cc2-87565afbb03b tempest-VolumeTypesAccessTest-1333911508 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-447754093 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-447754093, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:12:07 devstack cinder-volume[87046]: WARNING cinder.quota [None req-99eb8345-b8cb-40ea-8cc2-87565afbb03b tempest-VolumeTypesAccessTest-1333911508 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-447754093 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-447754093, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:12:07 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-99eb8345-b8cb-40ea-8cc2-87565afbb03b tempest-VolumeTypesAccessTest-1333911508 None] Created reservations ['bdeb5e0a-ae8d-4aa7-a72a-22c14b2044a1', '638c4899-8b0c-4030-aef0-7fae2c2dfc53', 'ed1500a1-39b7-4109-bfc2-4c8fce8a4834', '125d8498-a781-41bd-9cf2-35f23547cfaa'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:12:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-99eb8345-b8cb-40ea-8cc2-87565afbb03b tempest-VolumeTypesAccessTest-1333911508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:12:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-99eb8345-b8cb-40ea-8cc2-87565afbb03b tempest-VolumeTypesAccessTest-1333911508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:12:07 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-99eb8345-b8cb-40ea-8cc2-87565afbb03b tempest-VolumeTypesAccessTest-1333911508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:12:07 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-99eb8345-b8cb-40ea-8cc2-87565afbb03b tempest-VolumeTypesAccessTest-1333911508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:12:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-99eb8345-b8cb-40ea-8cc2-87565afbb03b tempest-VolumeTypesAccessTest-1333911508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:12:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-99eb8345-b8cb-40ea-8cc2-87565afbb03b tempest-VolumeTypesAccessTest-1333911508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:07 devstack sudo[95940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:12:07 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-99eb8345-b8cb-40ea-8cc2-87565afbb03b tempest-VolumeTypesAccessTest-1333911508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.385s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:07 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:07 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-99eb8345-b8cb-40ea-8cc2-87565afbb03b tempest-VolumeTypesAccessTest-1333911508 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:12:07 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-99eb8345-b8cb-40ea-8cc2-87565afbb03b tempest-VolumeTypesAccessTest-1333911508 None] Deleted volume successfully.
Sep 28 18:12:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-99eb8345-b8cb-40ea-8cc2-87565afbb03b tempest-VolumeTypesAccessTest-1333911508 None] Lock "cinder-e5603a58-c156-4ace-a6c4-aa1f905b8835-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:12:11 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-3e078988-c944-4d51-8496-9fa4b7081251 tempest-GroupsTest-1391210352 None] Group tempest-Group1-1670673699: creating
Sep 28 18:12:11 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-3e078988-c944-4d51-8496-9fa4b7081251 tempest-GroupsTest-1391210352 None] Group tempest-Group1-1670673699: created successfully
Sep 28 18:12:11 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-3e078988-c944-4d51-8496-9fa4b7081251 tempest-GroupsTest-1391210352 None] Create group completed successfully.
Sep 28 18:12:12 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:12:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Flow 'volume_create_manager' (ecfbf0f1-e074-47fc-b0b1-6746e6c5c25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:12:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62667f3-8f10-4371-96b1-9fbfc062ec0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62667f3-8f10-4371-96b1-9fbfc062ec0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-160017147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b94401-2176-4ddc-92a7-b4fa1139e872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8896c64795449aac3b701e13800d91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:12Z,use_quota=True,user_id='a202081dcd2948349af3c7b83ae5cc03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b283857-1514-4d5c-a03b-5b5c9c9b998e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b283857-1514-4d5c-a03b-5b5c9c9b998e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b208a532-2dee-4f7d-b1af-1ecb7720129b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:12 devstack cinder-volume[87046]: DEBUG cinder.image.glance [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Creating Keystone auth plugin from conf {{(pid=87046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 28 18:12:13 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-34081b41-e75b-4701-b244-19c31391ffff tempest-GroupsTest-1391210352 None] Group tempest-Group2-612125680: creating
Sep 28 18:12:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b208a532-2dee-4f7d-b1af-1ecb7720129b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '66b94401-2176-4ddc-92a7-b4fa1139e872', 'volume_name': 'volume-66b94401-2176-4ddc-92a7-b4fa1139e872', 'volume_size': 1, 'image_id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de2452cfca174dfbbc7b50b163b23faa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'created_at': datetime.datetime(2026, 9, 28, 15, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 58, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aaee37c80>}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e861503-0c6d-4b16-9b84-2bc50865a5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e861503-0c6d-4b16-9b84-2bc50865a5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e80bfd1-428c-4e7a-92ca-6adf712778a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:13 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Volume 66b94401-2176-4ddc-92a7-b4fa1139e872: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-66b94401-2176-4ddc-92a7-b4fa1139e872', 'volume_size': 1, 'image_id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de2452cfca174dfbbc7b50b163b23faa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'created_at': datetime.datetime(2026, 9, 28, 15, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 58, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aaee37c80>}
Sep 28 18:12:13 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Trying to clone 66b94401-2176-4ddc-92a7-b4fa1139e872 from image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}]). {{(pid=87046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 28 18:12:13 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-34081b41-e75b-4701-b244-19c31391ffff tempest-GroupsTest-1391210352 None] Group tempest-Group2-612125680: created successfully
Sep 28 18:12:13 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-34081b41-e75b-4701-b244-19c31391ffff tempest-GroupsTest-1391210352 None] Create group completed successfully.
Sep 28 18:12:13 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_cktma4mgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 28 18:12:13 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Image download 20.69 MB at 20.69 MB/s
Sep 28 18:12:13 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebf4207-826a-4cd2-a965-db72c7113929]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:12:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_cktma4mgdevstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:14 devstack sudo[95947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_cktma4mgdevstack@QuobyteHD
Sep 28 18:12:14 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:14 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_cktma4mgdevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:14 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Temporary image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 is fetched for user a202081dcd2948349af3c7b83ae5cc03. {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 28 18:12:14 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[05046c25-4564-45d4-98aa-392c030f6b51]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:12:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_cktma4mgdevstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:14 devstack sudo[95953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_cktma4mgdevstack@QuobyteHD
Sep 28 18:12:14 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:15 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_cktma4mgdevstack@QuobyteHD" returned: 0 in 0.580s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-160017147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b94401-2176-4ddc-92a7-b4fa1139e872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8896c64795449aac3b701e13800d91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:12Z,use_quota=True,user_id='a202081dcd2948349af3c7b83ae5cc03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Creating volume 66b94401-2176-4ddc-92a7-b4fa1139e872 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:12:15 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-66b94401-2176-4ddc-92a7-b4fa1139e872 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:15 devstack sudo[95958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-66b94401-2176-4ddc-92a7-b4fa1139e872 1073741824
Sep 28 18:12:15 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Flow 'volume_create_manager' (cd0a0949-d1a2-4f07-9a56-ebedf4a1002f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9381570c-3b3b-46ed-8249-d295dae93b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9381570c-3b3b-46ed-8249-d295dae93b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-730823655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ebc330c6-f181-4a8c-9202-10823b871040,host='devstack@QuobyteHD#QuobyteHD',id=cc774317-1038-4ad9-b678-cedafae861b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b86e1bad964c5a8bbb8cd8cbdba1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:15Z,use_quota=True,user_id='dc4194ba56c74adf8c769b2f9830c7aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aeab12b-90f7-4ac9-8bd3-66024ec94714),volume_type_id=0aeab12b-90f7-4ac9-8bd3-66024ec94714)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08cc51d2-89b6-40ab-a006-5def29030655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08cc51d2-89b6-40ab-a006-5def29030655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c4586fd-2375-428a-954e-cd7c034a036d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c4586fd-2375-428a-954e-cd7c034a036d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc774317-1038-4ad9-b678-cedafae861b4', 'volume_name': 'volume-cc774317-1038-4ad9-b678-cedafae861b4', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ed046b-99fb-4e3d-9ded-21f1b5f485e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ed046b-99fb-4e3d-9ded-21f1b5f485e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d301f5-e73c-4fbe-97f6-68e153ff6a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:15 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Volume cc774317-1038-4ad9-b678-cedafae861b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc774317-1038-4ad9-b678-cedafae861b4', 'volume_size': 1}
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:12:15 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-66b94401-2176-4ddc-92a7-b4fa1139e872 1073741824" returned: 0 in 0.768s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-66b94401-2176-4ddc-92a7-b4fa1139e872 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:15 devstack sudo[95964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-66b94401-2176-4ddc-92a7-b4fa1139e872
Sep 28 18:12:15 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:16 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-66b94401-2176-4ddc-92a7-b4fa1139e872" returned: 0 in 0.271s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:12:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:12:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.799s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:12:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ebc330c6-f181-4a8c-9202-10823b871040,created_at=2026-09-28T16:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-730823655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ebc330c6-f181-4a8c-9202-10823b871040,host='devstack@QuobyteHD#QuobyteHD',id=cc774317-1038-4ad9-b678-cedafae861b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b86e1bad964c5a8bbb8cd8cbdba1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:15Z,use_quota=True,user_id='dc4194ba56c74adf8c769b2f9830c7aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aeab12b-90f7-4ac9-8bd3-66024ec94714),volume_type_id=0aeab12b-90f7-4ac9-8bd3-66024ec94714)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:12:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Creating volume cc774317-1038-4ad9-b678-cedafae861b4 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:12:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:12:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:12:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:12:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:12:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:12:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:12:16 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:12:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc774317-1038-4ad9-b678-cedafae861b4 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:16 devstack sudo[95967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc774317-1038-4ad9-b678-cedafae861b4 1073741824
Sep 28 18:12:16 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:16 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Attempting download of c5b6ff95-792c-4fb0-b8e7-dea90bc76834 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}])) to volume 66b94401-2176-4ddc-92a7-b4fa1139e872. {{(pid=87046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 28 18:12:16 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cbab9a-19a9-403c-b522-b03b6672429f]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:12:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_ah_ctsez {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:16 devstack sudo[95969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_ah_ctsez
Sep 28 18:12:16 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:16 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_ah_ctsez" returned: 0 in 0.480s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_ah_ctsez {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:16 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc774317-1038-4ad9-b678-cedafae861b4 1073741824" returned: 0 in 0.799s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:17 devstack sudo[95976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_ah_ctsez
Sep 28 18:12:17 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc774317-1038-4ad9-b678-cedafae861b4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:17 devstack sudo[95979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc774317-1038-4ad9-b678-cedafae861b4
Sep 28 18:12:17 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:17 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_ah_ctsez" returned: 1 in 0.445s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_ah_ctsez' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:12:17 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0b67a6-853d-4361-80c9-074e2406258b]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:12:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_cktma4mgdevstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:17 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc774317-1038-4ad9-b678-cedafae861b4" returned: 0 in 0.379s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:12:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:12:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d301f5-e73c-4fbe-97f6-68e153ff6a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc774317-1038-4ad9-b678-cedafae861b4', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b87168-0420-4364-83a8-f26bd79bb85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:17 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Volume volume-cc774317-1038-4ad9-b678-cedafae861b4 (cc774317-1038-4ad9-b678-cedafae861b4): created successfully
Sep 28 18:12:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b87168-0420-4364-83a8-f26bd79bb85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:17 devstack sudo[95983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_cktma4mgdevstack@QuobyteHD
Sep 28 18:12:17 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Flow 'volume_create_manager' (cd0a0949-d1a2-4f07-9a56-ebedf4a1002f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:12:17 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-f863499d-af0b-4f46-a44a-32feeb11daad tempest-GroupsTest-1391210352 None] Created volume successfully.
Sep 28 18:12:17 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_cktma4mgdevstack@QuobyteHD" returned: 0 in 0.531s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:17 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] c5b6ff95-792c-4fb0-b8e7-dea90bc76834 was qcow2, converting to qcow2 {{(pid=87046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 28 18:12:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_cktma4mgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-66b94401-2176-4ddc-92a7-b4fa1139e872 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:17 devstack sudo[95989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_cktma4mgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-66b94401-2176-4ddc-92a7-b4fa1139e872
Sep 28 18:12:17 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:18 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=128,cinder:UPDATE=150,cinder:INSERT=37,cinder:DELETE=13 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:12:18 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:UPDATE=149,cinder:SELECT=151,cinder:INSERT=34,cinder:DELETE=2 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:12:18 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-263fb153-35c8-4e36-969a-cacd24d41f2f tempest-GroupsTest-1391210352 None] Acquiring lock "cinder-quobyte-cc774317-1038-4ad9-b678-cedafae861b4" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:12:18 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-263fb153-35c8-4e36-969a-cacd24d41f2f tempest-GroupsTest-1391210352 None] Lock "cinder-quobyte-cc774317-1038-4ad9-b678-cedafae861b4" acquired by "delete_volume" :: waited 0.032s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:12:18 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d974d6-63d6-4dd0-8f5e-8cf93cdb3bd2]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:12:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-263fb153-35c8-4e36-969a-cacd24d41f2f tempest-GroupsTest-1391210352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc774317-1038-4ad9-b678-cedafae861b4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:19 devstack sudo[95997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc774317-1038-4ad9-b678-cedafae861b4
Sep 28 18:12:19 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:19 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-263fb153-35c8-4e36-969a-cacd24d41f2f tempest-GroupsTest-1391210352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc774317-1038-4ad9-b678-cedafae861b4" returned: 0 in 0.720s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-263fb153-35c8-4e36-969a-cacd24d41f2f tempest-GroupsTest-1391210352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc774317-1038-4ad9-b678-cedafae861b4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:19 devstack sudo[96036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc774317-1038-4ad9-b678-cedafae861b4
Sep 28 18:12:19 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:20 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-263fb153-35c8-4e36-969a-cacd24d41f2f tempest-GroupsTest-1391210352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc774317-1038-4ad9-b678-cedafae861b4" returned: 0 in 0.467s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:20 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-263fb153-35c8-4e36-969a-cacd24d41f2f tempest-GroupsTest-1391210352 None] Lock "cinder-quobyte-cc774317-1038-4ad9-b678-cedafae861b4" released by "delete_volume" :: held 1.260s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:12:20 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-263fb153-35c8-4e36-969a-cacd24d41f2f tempest-GroupsTest-1391210352 None] Created reservations ['553465fa-75cf-46e7-bdca-219a9c30a70d'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:12:20 devstack cinder-volume[87046]: WARNING cinder.quota [None req-263fb153-35c8-4e36-969a-cacd24d41f2f tempest-GroupsTest-1391210352 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-918071479 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-918071479, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:12:20 devstack cinder-volume[87046]: WARNING cinder.quota [None req-263fb153-35c8-4e36-969a-cacd24d41f2f tempest-GroupsTest-1391210352 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-918071479 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-918071479, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:12:20 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-263fb153-35c8-4e36-969a-cacd24d41f2f tempest-GroupsTest-1391210352 None] Created reservations ['6a5d7d9c-db64-45e8-b19b-7f1437867e74', 'f3f247eb-3d38-4b7e-ab12-12816011fbb5', 'd19ed391-f182-4e40-a662-272d385d6099', '62d281a8-6781-44ed-9773-33b110001b77'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:12:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-263fb153-35c8-4e36-969a-cacd24d41f2f tempest-GroupsTest-1391210352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:12:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-263fb153-35c8-4e36-969a-cacd24d41f2f tempest-GroupsTest-1391210352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:12:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-263fb153-35c8-4e36-969a-cacd24d41f2f tempest-GroupsTest-1391210352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:12:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-263fb153-35c8-4e36-969a-cacd24d41f2f tempest-GroupsTest-1391210352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:12:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-263fb153-35c8-4e36-969a-cacd24d41f2f tempest-GroupsTest-1391210352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:12:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-263fb153-35c8-4e36-969a-cacd24d41f2f tempest-GroupsTest-1391210352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:20 devstack sudo[96042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:12:20 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:20 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_cktma4mgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-66b94401-2176-4ddc-92a7-b4fa1139e872" returned: 0 in 3.086s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:20 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_cktma4mgdevstack@QuobyteHD, size 112.00 MB, duration 3.09 sec, destination /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-66b94401-2176-4ddc-92a7-b4fa1139e872 {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:12:20 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Converted 112.00 MB image at 36.28 MB/s
Sep 28 18:12:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-66b94401-2176-4ddc-92a7-b4fa1139e872 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:21 devstack sudo[96046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-66b94401-2176-4ddc-92a7-b4fa1139e872 1G
Sep 28 18:12:21 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:21 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-263fb153-35c8-4e36-969a-cacd24d41f2f tempest-GroupsTest-1391210352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.384s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:21 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-263fb153-35c8-4e36-969a-cacd24d41f2f tempest-GroupsTest-1391210352 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:12:21 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-263fb153-35c8-4e36-969a-cacd24d41f2f tempest-GroupsTest-1391210352 None] Delete group completed successfully.
Sep 28 18:12:21 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-66b94401-2176-4ddc-92a7-b4fa1139e872 1G" returned: 0 in 0.439s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:21 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Downloaded image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}])) to volume 66b94401-2176-4ddc-92a7-b4fa1139e872 successfully. {{(pid=87046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 28 18:12:21 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Temporary image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 for user a202081dcd2948349af3c7b83ae5cc03 is deleted. {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 28 18:12:21 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Marking volume 66b94401-2176-4ddc-92a7-b4fa1139e872 as bootable. {{(pid=87046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 28 18:12:21 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Copying metadata from image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 to 66b94401-2176-4ddc-92a7-b4fa1139e872. {{(pid=87046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 28 18:12:21 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Creating volume glance metadata for volume 66b94401-2176-4ddc-92a7-b4fa1139e872 backed by image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 28 18:12:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e80bfd1-428c-4e7a-92ca-6adf712778a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b94401-2176-4ddc-92a7-b4fa1139e872', 'volume_size': 1, 'image_id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de2452cfca174dfbbc7b50b163b23faa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'created_at': datetime.datetime(2026, 9, 28, 15, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 58, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aaee37c80>}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c536320f-06a9-40fa-af04-93c5e3e5a4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:21 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Volume volume-66b94401-2176-4ddc-92a7-b4fa1139e872 (66b94401-2176-4ddc-92a7-b4fa1139e872): created successfully
Sep 28 18:12:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c536320f-06a9-40fa-af04-93c5e3e5a4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Flow 'volume_create_manager' (ecfbf0f1-e074-47fc-b0b1-6746e6c5c25d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:12:21 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-18707b87-bd30-48f9-a4ef-3f41e24a9427 tempest-TestShelveInstance-1993482088 None] Created volume successfully.
Sep 28 18:12:21 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-6f0e64e3-dcf1-4db0-bef5-c229726f3c70 tempest-GroupsTest-1391210352 None] Created reservations ['838b5b1a-b910-47be-af0f-a2803ee0aaef'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:12:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6f0e64e3-dcf1-4db0-bef5-c229726f3c70 tempest-GroupsTest-1391210352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:12:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6f0e64e3-dcf1-4db0-bef5-c229726f3c70 tempest-GroupsTest-1391210352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:12:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6f0e64e3-dcf1-4db0-bef5-c229726f3c70 tempest-GroupsTest-1391210352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:12:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6f0e64e3-dcf1-4db0-bef5-c229726f3c70 tempest-GroupsTest-1391210352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:12:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6f0e64e3-dcf1-4db0-bef5-c229726f3c70 tempest-GroupsTest-1391210352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:12:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6f0e64e3-dcf1-4db0-bef5-c229726f3c70 tempest-GroupsTest-1391210352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:21 devstack sudo[96053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:12:21 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:22 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6f0e64e3-dcf1-4db0-bef5-c229726f3c70 tempest-GroupsTest-1391210352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.408s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:22 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-6f0e64e3-dcf1-4db0-bef5-c229726f3c70 tempest-GroupsTest-1391210352 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:12:22 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-6f0e64e3-dcf1-4db0-bef5-c229726f3c70 tempest-GroupsTest-1391210352 None] Delete group completed successfully.
Sep 28 18:12:23 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-0954a6f0-c987-485f-bdf3-33f0da60fc66 tempest-GroupsTest-1391210352 None] Group tempest-GroupsTest-Group-19459472: creating
Sep 28 18:12:23 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-0954a6f0-c987-485f-bdf3-33f0da60fc66 tempest-GroupsTest-1391210352 None] Group tempest-GroupsTest-Group-19459472: created successfully
Sep 28 18:12:23 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-0954a6f0-c987-485f-bdf3-33f0da60fc66 tempest-GroupsTest-1391210352 None] Create group completed successfully.
Sep 28 18:12:25 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:12:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Flow 'volume_create_manager' (9306bc96-fba7-4a8f-8490-9b52f66a8d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:12:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698ba6b3-53f9-42c2-822e-4564cc350db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698ba6b3-53f9-42c2-822e-4564cc350db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-531936946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6c239919-6034-4bd4-8b9b-d8ca9aac2096,host='devstack@QuobyteHD#QuobyteHD',id=45db6c17-3684-4c60-ab7f-79011b5829da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b86e1bad964c5a8bbb8cd8cbdba1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:25Z,use_quota=True,user_id='dc4194ba56c74adf8c769b2f9830c7aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3aead908-3177-4e62-bc66-b273f2bb0a52),volume_type_id=3aead908-3177-4e62-bc66-b273f2bb0a52)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db26526a-b8bd-4a32-8e1c-107227504ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db26526a-b8bd-4a32-8e1c-107227504ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (398bfe3b-6393-4d27-9350-3f6396277784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (398bfe3b-6393-4d27-9350-3f6396277784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45db6c17-3684-4c60-ab7f-79011b5829da', 'volume_name': 'volume-45db6c17-3684-4c60-ab7f-79011b5829da', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd31487-7bc6-4be5-b2f0-78d5e6d3e691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd31487-7bc6-4be5-b2f0-78d5e6d3e691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e523187-34b0-4ace-bea5-7d2316161589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:25 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Volume 45db6c17-3684-4c60-ab7f-79011b5829da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45db6c17-3684-4c60-ab7f-79011b5829da', 'volume_size': 1}
Sep 28 18:12:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:12:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:12:25 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6c239919-6034-4bd4-8b9b-d8ca9aac2096,created_at=2026-09-28T16:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-531936946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6c239919-6034-4bd4-8b9b-d8ca9aac2096,host='devstack@QuobyteHD#QuobyteHD',id=45db6c17-3684-4c60-ab7f-79011b5829da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b86e1bad964c5a8bbb8cd8cbdba1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:25Z,use_quota=True,user_id='dc4194ba56c74adf8c769b2f9830c7aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3aead908-3177-4e62-bc66-b273f2bb0a52),volume_type_id=3aead908-3177-4e62-bc66-b273f2bb0a52)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:12:25 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Creating volume 45db6c17-3684-4c60-ab7f-79011b5829da {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:12:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:12:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:12:25 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:12:25 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:12:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:12:25 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:12:25 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:12:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45db6c17-3684-4c60-ab7f-79011b5829da 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:25 devstack sudo[96058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45db6c17-3684-4c60-ab7f-79011b5829da 1073741824
Sep 28 18:12:25 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:26 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45db6c17-3684-4c60-ab7f-79011b5829da 1073741824" returned: 0 in 0.624s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45db6c17-3684-4c60-ab7f-79011b5829da {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:26 devstack sudo[96067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45db6c17-3684-4c60-ab7f-79011b5829da
Sep 28 18:12:26 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:26 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45db6c17-3684-4c60-ab7f-79011b5829da" returned: 0 in 0.391s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:12:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:12:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e523187-34b0-4ace-bea5-7d2316161589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45db6c17-3684-4c60-ab7f-79011b5829da', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c76d4cda-92db-4050-a564-71b0149c5570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:26 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Volume volume-45db6c17-3684-4c60-ab7f-79011b5829da (45db6c17-3684-4c60-ab7f-79011b5829da): created successfully
Sep 28 18:12:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c76d4cda-92db-4050-a564-71b0149c5570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Flow 'volume_create_manager' (9306bc96-fba7-4a8f-8490-9b52f66a8d3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:12:26 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-9c3d1d07-d1f4-4d1d-84ea-584137b33943 tempest-GroupsTest-1391210352 None] Created volume successfully.
Sep 28 18:12:28 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Flow 'volume_create_manager' (0fe278d1-fb50-4534-97d6-3de9a6692591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79893220-4aa4-4202-a4c6-763d811ca801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79893220-4aa4-4202-a4c6-763d811ca801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1202141803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6c239919-6034-4bd4-8b9b-d8ca9aac2096,host='devstack@QuobyteHD#QuobyteHD',id=47a29b6f-d4f6-451d-ae3e-e0043b79896d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b86e1bad964c5a8bbb8cd8cbdba1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:29Z,use_quota=True,user_id='dc4194ba56c74adf8c769b2f9830c7aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3aead908-3177-4e62-bc66-b273f2bb0a52),volume_type_id=3aead908-3177-4e62-bc66-b273f2bb0a52)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e48cf0a-9ba2-4aad-bce5-09a4dbd35b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e48cf0a-9ba2-4aad-bce5-09a4dbd35b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bceb27c-8784-4669-8e41-4bfb1acac613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bceb27c-8784-4669-8e41-4bfb1acac613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47a29b6f-d4f6-451d-ae3e-e0043b79896d', 'volume_name': 'volume-47a29b6f-d4f6-451d-ae3e-e0043b79896d', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd19313-4389-4208-bfd6-b89b837b7d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd19313-4389-4208-bfd6-b89b837b7d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a33a3da-6e7b-4c2b-9c72-6417b2df2129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:29 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Volume 47a29b6f-d4f6-451d-ae3e-e0043b79896d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47a29b6f-d4f6-451d-ae3e-e0043b79896d', 'volume_size': 1}
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6c239919-6034-4bd4-8b9b-d8ca9aac2096,created_at=2026-09-28T16:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1202141803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6c239919-6034-4bd4-8b9b-d8ca9aac2096,host='devstack@QuobyteHD#QuobyteHD',id=47a29b6f-d4f6-451d-ae3e-e0043b79896d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b86e1bad964c5a8bbb8cd8cbdba1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:29Z,use_quota=True,user_id='dc4194ba56c74adf8c769b2f9830c7aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3aead908-3177-4e62-bc66-b273f2bb0a52),volume_type_id=3aead908-3177-4e62-bc66-b273f2bb0a52)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Creating volume 47a29b6f-d4f6-451d-ae3e-e0043b79896d {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:12:29 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47a29b6f-d4f6-451d-ae3e-e0043b79896d 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:29 devstack sudo[96070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47a29b6f-d4f6-451d-ae3e-e0043b79896d 1073741824
Sep 28 18:12:29 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:29 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47a29b6f-d4f6-451d-ae3e-e0043b79896d 1073741824" returned: 0 in 0.702s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47a29b6f-d4f6-451d-ae3e-e0043b79896d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:30 devstack sudo[96079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47a29b6f-d4f6-451d-ae3e-e0043b79896d
Sep 28 18:12:30 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:30 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47a29b6f-d4f6-451d-ae3e-e0043b79896d" returned: 0 in 0.424s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:12:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:12:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a33a3da-6e7b-4c2b-9c72-6417b2df2129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47a29b6f-d4f6-451d-ae3e-e0043b79896d', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee829d74-94fb-4bbf-b83c-d54d4e96d4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:30 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Volume volume-47a29b6f-d4f6-451d-ae3e-e0043b79896d (47a29b6f-d4f6-451d-ae3e-e0043b79896d): created successfully
Sep 28 18:12:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee829d74-94fb-4bbf-b83c-d54d4e96d4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Flow 'volume_create_manager' (0fe278d1-fb50-4534-97d6-3de9a6692591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:12:30 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-e34a3e2f-0781-4161-9194-7ced0af5dd22 tempest-GroupsTest-1391210352 None] Created volume successfully.
Sep 28 18:12:31 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-86cf9cb7-2c91-4d36-a496-a77c1e15a35d tempest-GroupsTest-1391210352 None] Update group completed successfully.
Sep 28 18:12:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-c635a161-b5d8-404b-89c8-348e0bdf3cd9 req-bab4d241-1e95-4df2-946f-45ff6683098d tempest-TestShelveInstance-1993482088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:12:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-c635a161-b5d8-404b-89c8-348e0bdf3cd9 req-bab4d241-1e95-4df2-946f-45ff6683098d tempest-TestShelveInstance-1993482088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:12:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-c635a161-b5d8-404b-89c8-348e0bdf3cd9 req-bab4d241-1e95-4df2-946f-45ff6683098d tempest-TestShelveInstance-1993482088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:12:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-c635a161-b5d8-404b-89c8-348e0bdf3cd9 req-bab4d241-1e95-4df2-946f-45ff6683098d tempest-TestShelveInstance-1993482088 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-66b94401-2176-4ddc-92a7-b4fa1139e872', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d56ed05-89e9-451c-b531-67d9093019fa', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:12:32 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-c635a161-b5d8-404b-89c8-348e0bdf3cd9 req-bab4d241-1e95-4df2-946f-45ff6683098d tempest-TestShelveInstance-1993482088 None] attachment_update completed successfully.
Sep 28 18:12:33 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d16f6522-a77f-4dc7-b30b-a3ffc7a2f0ee tempest-GroupsTest-1391210352 None] Update group completed successfully.
Sep 28 18:12:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Acquiring lock "cinder-quobyte-45db6c17-3684-4c60-ab7f-79011b5829da" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:12:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Lock "cinder-quobyte-45db6c17-3684-4c60-ab7f-79011b5829da" acquired by "delete_volume" :: waited 0.034s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:12:35 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0fb455-d94b-4439-8f40-7c547bcdf0bc]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:12:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45db6c17-3684-4c60-ab7f-79011b5829da {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:35 devstack sudo[96092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45db6c17-3684-4c60-ab7f-79011b5829da
Sep 28 18:12:35 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:36 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45db6c17-3684-4c60-ab7f-79011b5829da" returned: 0 in 0.539s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45db6c17-3684-4c60-ab7f-79011b5829da {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:36 devstack sudo[96097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45db6c17-3684-4c60-ab7f-79011b5829da
Sep 28 18:12:36 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:36 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45db6c17-3684-4c60-ab7f-79011b5829da" returned: 0 in 0.336s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Lock "cinder-quobyte-45db6c17-3684-4c60-ab7f-79011b5829da" released by "delete_volume" :: held 0.973s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:12:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Acquiring lock "cinder-quobyte-47a29b6f-d4f6-451d-ae3e-e0043b79896d" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:12:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Lock "cinder-quobyte-47a29b6f-d4f6-451d-ae3e-e0043b79896d" acquired by "delete_volume" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:12:36 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8b6c5c-9a7e-4fff-9a28-9d748aade287]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:12:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47a29b6f-d4f6-451d-ae3e-e0043b79896d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:36 devstack sudo[96101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47a29b6f-d4f6-451d-ae3e-e0043b79896d
Sep 28 18:12:36 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:37 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47a29b6f-d4f6-451d-ae3e-e0043b79896d" returned: 0 in 0.619s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47a29b6f-d4f6-451d-ae3e-e0043b79896d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:37 devstack sudo[96107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47a29b6f-d4f6-451d-ae3e-e0043b79896d
Sep 28 18:12:37 devstack sudo[96107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:37 devstack sudo[96107]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47a29b6f-d4f6-451d-ae3e-e0043b79896d" returned: 0 in 0.399s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Lock "cinder-quobyte-47a29b6f-d4f6-451d-ae3e-e0043b79896d" released by "delete_volume" :: held 1.094s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:12:37 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Created reservations ['ddc98429-a93b-47e3-997e-54b1d57b0fcb'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:12:37 devstack cinder-volume[87046]: WARNING cinder.quota [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2038740550 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2038740550, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:12:37 devstack cinder-volume[87046]: WARNING cinder.quota [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2038740550 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2038740550, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:12:37 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Created reservations ['dd1019c9-c3d0-4e64-bfff-bb95f5839580', '10ae4b30-9914-4372-8b80-ad617e85dfa4', '8168da3f-c58b-404c-98e1-28a0900d72cf', '689790c9-f7bc-470c-bc6b-38d8e2bbd539'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:12:38 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Created reservations ['88838a8c-3862-4bee-ae1f-82680a9690ed', '5e38ac1f-87ca-477d-a3c0-65c1ffe64cf3', 'adaa21d1-8e7b-4494-b04c-63516e862e4d', 'b9f11a0b-c699-4d92-817e-7068ae5923f1'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:12:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:12:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:12:38 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:12:38 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:12:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.068s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:12:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:38 devstack sudo[96223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:12:38 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:39 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.494s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:12:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:12:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:12:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:12:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:12:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:12:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:12:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:39 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-71fa8a9f-0fe1-40fc-9fbf-d4e511c17811 tempest-GroupsTest-1391210352 None] Delete group completed successfully.
Sep 28 18:12:39 devstack sudo[96563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:12:39 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:12:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.578s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:12:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:12:39 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root
Sep 28 18:12:40 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:12:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:12:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:12:48 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=49,cinder:UPDATE=40,cinder:INSERT=16,cinder:DELETE=1 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:12:48 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:UPDATE=48,cinder:SELECT=47,cinder:INSERT=13,cinder:DELETE=2 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:12:55 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-ba1e3263-bad5-4018-8c08-09827c12f479 tempest-GroupsV314Test-1779137991 None] Group tempest-GroupsV314Test-Group-1048179052: creating
Sep 28 18:12:55 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-ba1e3263-bad5-4018-8c08-09827c12f479 tempest-GroupsV314Test-1779137991 None] Group tempest-GroupsV314Test-Group-1048179052: created successfully
Sep 28 18:12:55 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-ba1e3263-bad5-4018-8c08-09827c12f479 tempest-GroupsV314Test-1779137991 None] Create group completed successfully.
Sep 28 18:12:58 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:12:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Flow 'volume_create_manager' (8a85d76f-f70c-42e1-9ddb-bfe9ac248365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:12:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d57a84-d632-4f34-9f6b-750bb79148a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d57a84-d632-4f34-9f6b-750bb79148a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1539094931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d330d772-2f66-4152-b0d8-62ec08c6393c,host='devstack@QuobyteHD#QuobyteHD',id=f93322a9-cebb-4987-9dfd-2b77a7a1d7bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7025b2e57fc40baa0b273b76251497c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:59Z,use_quota=True,user_id='5f5c0864e2744050bd89acb2b4158a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(706e5350-a3e5-48bb-86ba-3c624852e4d3),volume_type_id=706e5350-a3e5-48bb-86ba-3c624852e4d3)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e6da31-fda9-490a-8227-823a452c418d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e6da31-fda9-490a-8227-823a452c418d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d56b00-559c-4806-8816-21d9c6f1d008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d56b00-559c-4806-8816-21d9c6f1d008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f93322a9-cebb-4987-9dfd-2b77a7a1d7bd', 'volume_name': 'volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d2ac25-c099-44f1-ab4f-ebda6a70eb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d2ac25-c099-44f1-ab4f-ebda6a70eb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:12:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04cd8616-a469-4a96-86ed-71f79978c02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:12:58 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Volume f93322a9-cebb-4987-9dfd-2b77a7a1d7bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd', 'volume_size': 1}
Sep 28 18:12:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:12:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:12:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d330d772-2f66-4152-b0d8-62ec08c6393c,created_at=2026-09-28T16:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1539094931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d330d772-2f66-4152-b0d8-62ec08c6393c,host='devstack@QuobyteHD#QuobyteHD',id=f93322a9-cebb-4987-9dfd-2b77a7a1d7bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7025b2e57fc40baa0b273b76251497c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:59Z,use_quota=True,user_id='5f5c0864e2744050bd89acb2b4158a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(706e5350-a3e5-48bb-86ba-3c624852e4d3),volume_type_id=706e5350-a3e5-48bb-86ba-3c624852e4d3)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:12:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Creating volume f93322a9-cebb-4987-9dfd-2b77a7a1d7bd {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:12:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:12:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:12:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:12:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:12:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:12:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:12:58 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:12:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:12:59 devstack sudo[96741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd 1073741824
Sep 28 18:12:59 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:00 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd 1073741824" returned: 0 in 1.232s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:00 devstack sudo[96752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd
Sep 28 18:13:00 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:00 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd" returned: 0 in 0.552s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:13:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.963s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04cd8616-a469-4a96-86ed-71f79978c02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a060ed4-0686-47a7-9e1e-db74bdda7473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:00 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Volume volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd (f93322a9-cebb-4987-9dfd-2b77a7a1d7bd): created successfully
Sep 28 18:13:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a060ed4-0686-47a7-9e1e-db74bdda7473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Flow 'volume_create_manager' (8a85d76f-f70c-42e1-9ddb-bfe9ac248365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:13:01 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-833e5e48-38f2-424e-9b44-2a259613fa8d tempest-GroupsV314Test-1779137991 None] Created volume successfully.
Sep 28 18:13:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:03 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Cloning volume f93322a9-cebb-4987-9dfd-2b77a7a1d7bd to volume 2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0
Sep 28 18:13:03 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Creating offline snapshot 987b02ae-8b18-44dc-8059-9e45a85316f9 of volume f93322a9-cebb-4987-9dfd-2b77a7a1d7bd {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:13:03 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fb5ef9-d284-40b3-be80-789aa588201d]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:13:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:04 devstack sudo[96770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd
Sep 28 18:13:04 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:04 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd" returned: 0 in 0.941s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:04 devstack sudo[96779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9 1G
Sep 28 18:13:04 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:05 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9 1G" returned: 0 in 1.088s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:05 devstack sudo[96788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9
Sep 28 18:13:05 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:06 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9" returned: 0 in 0.548s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:06 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9 is being set with open permissions: ugo+rw: NotImplementedError
Sep 28 18:13:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:06 devstack sudo[96804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9
Sep 28 18:13:06 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:06 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9" returned: 0 in 0.482s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:06 devstack sudo[96807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.info
Sep 28 18:13:06 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:07 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.info" returned: 0 in 0.309s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:07 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 28 18:13:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:07 devstack sudo[96810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.info
Sep 28 18:13:07 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:07 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.info" returned: 0 in 0.408s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Acquiring lock "cinder-quobyte-2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0" by "_copy_volume_from_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:13:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Lock "cinder-quobyte-2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:13:07 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] snapshot: 987b02ae-8b18-44dc-8059-9e45a85316f9, volume: 2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0,  {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 28 18:13:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:07 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:13:07 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:13:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:07 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d5c399-b771-4825-8dfb-578917ec87b4]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:13:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:07 devstack sudo[96813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9
Sep 28 18:13:07 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:08 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9" returned: 0 in 0.641s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:13:08 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0556b850-ffe2-4f0e-9b5f-80daf275ada1]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:13:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:08 devstack sudo[96828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd
Sep 28 18:13:08 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:08 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd" returned: 0 in 0.588s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 28 18:13:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Creating direct copy from snapshot {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 28 18:13:09 devstack cinder-volume[87046]: DEBUG cinder.utils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Path /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0 not found in is_blk_device check {{(pid=87046) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 28 18:13:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:09 devstack sudo[96839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0
Sep 28 18:13:09 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:16 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=10,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:13:16 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:UPDATE=4,cinder:SELECT=9,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:13:21 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0" returned: 0 in 12.984s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:21 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Image conversion details: src /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd, size 1024.00 MB, duration 12.99 sec, destination /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0 {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:13:21 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Converted 1024.00 MB image at 78.86 MB/s
Sep 28 18:13:21 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0 is being set with open permissions: ugo+rw: NotImplementedError
Sep 28 18:13:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:22 devstack sudo[97002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0
Sep 28 18:13:22 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:22 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0" returned: 0 in 0.556s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Lock "cinder-quobyte-2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0" released by "_copy_volume_from_snapshot" :: held 14.918s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:13:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Acquiring lock "cinder-quobyte-987b02ae-8b18-44dc-8059-9e45a85316f9" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:13:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Lock "cinder-quobyte-987b02ae-8b18-44dc-8059-9e45a85316f9" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:13:22 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Deleting offline snapshot 987b02ae-8b18-44dc-8059-9e45a85316f9 of volume f93322a9-cebb-4987-9dfd-2b77a7a1d7bd {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:13:22 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] snapshot_file for this snap is: volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:13:22 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f431c5-ce52-4c47-88cf-70db233ced03]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:13:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:22 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:13:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Flow 'volume_create_manager' (aab93eed-35ee-45d0-8102-f21054411a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:13:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b6442e2-2f0e-4aab-8ee4-9621a6fed7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:23 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b6442e2-2f0e-4aab-8ee4-9621a6fed7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2086390629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9ddc80-c59b-458d-977a-a3ff80358c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18da014b7334309a1065e21232ae2e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:23Z,use_quota=True,user_id='b517be55405d43f5b4c5bc92568a6bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:23 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477e68c4-fc80-41f4-9d03-b0bc0a88d434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:23 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477e68c4-fc80-41f4-9d03-b0bc0a88d434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:23 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e35f7a-afc4-437e-801f-ea6a2cf612ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:23 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e35f7a-afc4-437e-801f-ea6a2cf612ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e9ddc80-c59b-458d-977a-a3ff80358c8c', 'volume_name': 'volume-0e9ddc80-c59b-458d-977a-a3ff80358c8c', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:23 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0109aff6-c6a9-4b85-a4a8-176b2b700c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:23 devstack sudo[97006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9
Sep 28 18:13:23 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:23 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0109aff6-c6a9-4b85-a4a8-176b2b700c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:23 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2373716e-3bd2-4c5b-9389-e1fc3ff4e890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:23 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Volume 0e9ddc80-c59b-458d-977a-a3ff80358c8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e9ddc80-c59b-458d-977a-a3ff80358c8c', 'volume_size': 1}
Sep 28 18:13:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:24 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9" returned: 0 in 1.279s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:13:24 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2db09e-cc6e-48c8-bd05-e3d0c8958085]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:13:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:24 devstack sudo[97034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd
Sep 28 18:13:24 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:24 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-fe6a19eb-1f07-48ea-8d3f-d9d17ad922a5 req-9489409d-f989-4088-8086-1b303ac5f26d tempest-TestShelveInstance-1993482088 None] Terminate volume connection completed successfully.
Sep 28 18:13:24 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-fe6a19eb-1f07-48ea-8d3f-d9d17ad922a5 req-9489409d-f989-4088-8086-1b303ac5f26d tempest-TestShelveInstance-1993482088 None] Deleting attachment 6d56ed05-89e9-451c-b531-67d9093019fa. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:13:25 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd" returned: 0 in 0.950s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:25 devstack sudo[97040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9
Sep 28 18:13:25 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:25 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:13:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Flow 'volume_create_manager' (ce31de1e-5e09-446b-baf9-4258cdfcb978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:13:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0191f33f-501f-4fe5-9d44-5d5b42094487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0191f33f-501f-4fe5-9d44-5d5b42094487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1249090228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b840303f-96d8-4b7c-ab2f-97bf63228649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8ac573af3742b5a7febc9c35a6057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:25Z,use_quota=True,user_id='46dfea941a274f1a85f70bef0a6c2d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ae5ca2-57d1-4369-837e-6506e0b3758e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ae5ca2-57d1-4369-837e-6506e0b3758e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d52f9822-f358-46d7-82f3-75b2bb2b5d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d52f9822-f358-46d7-82f3-75b2bb2b5d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b840303f-96d8-4b7c-ab2f-97bf63228649', 'volume_name': 'volume-b840303f-96d8-4b7c-ab2f-97bf63228649', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d0a9f1-01e6-4bb3-87b4-0dca87d5c17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d0a9f1-01e6-4bb3-87b4-0dca87d5c17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd15cda-5b1a-4b4c-be17-3e05db4780a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:25 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Volume b840303f-96d8-4b7c-ab2f-97bf63228649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b840303f-96d8-4b7c-ab2f-97bf63228649', 'volume_size': 1}
Sep 28 18:13:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:25 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9" returned: 0 in 0.730s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:25 devstack sudo[97045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9
Sep 28 18:13:25 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:26 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd.987b02ae-8b18-44dc-8059-9e45a85316f9" returned: 0 in 0.322s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:26 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Lock "cinder-quobyte-987b02ae-8b18-44dc-8059-9e45a85316f9" released by "_delete_snapshot" :: held 3.508s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:13:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.654s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.084s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2086390629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9ddc80-c59b-458d-977a-a3ff80358c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18da014b7334309a1065e21232ae2e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:23Z,use_quota=True,user_id='b517be55405d43f5b4c5bc92568a6bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:13:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Creating volume 0e9ddc80-c59b-458d-977a-a3ff80358c8c {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:13:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:13:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:13:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:13:26 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:13:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e9ddc80-c59b-458d-977a-a3ff80358c8c 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:26 devstack sudo[97048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e9ddc80-c59b-458d-977a-a3ff80358c8c 1073741824
Sep 28 18:13:26 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:26 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-2896bee1-63fb-4b13-a074-1b11ec2bfb5c tempest-GroupsV314Test-1779137991 None] Create group from source-group-d330d772-2f66-4152-b0d8-62ec08c6393c completed successfully.
Sep 28 18:13:27 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e9ddc80-c59b-458d-977a-a3ff80358c8c 1073741824" returned: 0 in 0.786s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e9ddc80-c59b-458d-977a-a3ff80358c8c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:27 devstack sudo[97057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e9ddc80-c59b-458d-977a-a3ff80358c8c
Sep 28 18:13:27 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:27 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e9ddc80-c59b-458d-977a-a3ff80358c8c" returned: 0 in 0.570s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:13:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.199s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1249090228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b840303f-96d8-4b7c-ab2f-97bf63228649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8ac573af3742b5a7febc9c35a6057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:25Z,use_quota=True,user_id='46dfea941a274f1a85f70bef0a6c2d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:13:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Creating volume b840303f-96d8-4b7c-ab2f-97bf63228649 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:13:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:13:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:13:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:13:27 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:13:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b840303f-96d8-4b7c-ab2f-97bf63228649 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:27 devstack sudo[97062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b840303f-96d8-4b7c-ab2f-97bf63228649 1073741824
Sep 28 18:13:27 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2373716e-3bd2-4c5b-9389-e1fc3ff4e890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e9ddc80-c59b-458d-977a-a3ff80358c8c', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76facb6-c574-4dfb-a96e-e55a2dd258e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:27 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Volume volume-0e9ddc80-c59b-458d-977a-a3ff80358c8c (0e9ddc80-c59b-458d-977a-a3ff80358c8c): created successfully
Sep 28 18:13:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76facb6-c574-4dfb-a96e-e55a2dd258e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Flow 'volume_create_manager' (aab93eed-35ee-45d0-8102-f21054411a70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:13:27 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d4e2459c-2f1a-472e-8440-3006b319e43f tempest-VolumesActionsTest-917175075 None] Created volume successfully.
Sep 28 18:13:28 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a95ac555-dc95-4fea-96a2-ca9b71faf3d6 tempest-GroupsV314Test-1779137991 None] Acquiring lock "cinder-quobyte-2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:13:28 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a95ac555-dc95-4fea-96a2-ca9b71faf3d6 tempest-GroupsV314Test-1779137991 None] Lock "cinder-quobyte-2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0" acquired by "delete_volume" :: waited 0.024s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:13:28 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9afc43-423a-493e-841d-e5905f2f896e]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:13:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a95ac555-dc95-4fea-96a2-ca9b71faf3d6 tempest-GroupsV314Test-1779137991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:28 devstack sudo[97064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0
Sep 28 18:13:28 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:28 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:28 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b2a1e658-f801-417f-a755-605c04194c88 tempest-VolumesActionsTest-917175075 None] Acquiring lock "cinder-0e9ddc80-c59b-458d-977a-a3ff80358c8c" by "attach_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:13:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b840303f-96d8-4b7c-ab2f-97bf63228649 1073741824" returned: 0 in 1.071s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:28 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b2a1e658-f801-417f-a755-605c04194c88 tempest-VolumesActionsTest-917175075 None] Lock "cinder-0e9ddc80-c59b-458d-977a-a3ff80358c8c" acquired by "attach_volume" :: waited 0.060s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:13:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b840303f-96d8-4b7c-ab2f-97bf63228649 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:29 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a95ac555-dc95-4fea-96a2-ca9b71faf3d6 tempest-GroupsV314Test-1779137991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0" returned: 0 in 0.903s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a95ac555-dc95-4fea-96a2-ca9b71faf3d6 tempest-GroupsV314Test-1779137991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:29 devstack sudo[97078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b840303f-96d8-4b7c-ab2f-97bf63228649
Sep 28 18:13:29 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:29 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-b2a1e658-f801-417f-a755-605c04194c88 tempest-VolumesActionsTest-917175075 None] Attaching volume 0e9ddc80-c59b-458d-977a-a3ff80358c8c to instance 7cd73bb0-2ca0-489b-9225-d4a3e91e5ef9 at mountpoint /dev/vdb on host None.
Sep 28 18:13:29 devstack sudo[97082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0
Sep 28 18:13:29 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:29 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-b2a1e658-f801-417f-a755-605c04194c88 tempest-VolumesActionsTest-917175075 None] Attach volume completed successfully.
Sep 28 18:13:29 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b2a1e658-f801-417f-a755-605c04194c88 tempest-VolumesActionsTest-917175075 None] Lock "cinder-0e9ddc80-c59b-458d-977a-a3ff80358c8c" released by "attach_volume" :: held 0.305s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:13:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-6b99a531-a66e-48b3-8c61-b5de746938e6 req-c8b9ccec-7d3f-4bb2-8994-9eb683ea4149 tempest-TestShelveInstance-1993482088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:29 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b840303f-96d8-4b7c-ab2f-97bf63228649" returned: 0 in 0.558s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:13:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-6b99a531-a66e-48b3-8c61-b5de746938e6 req-c8b9ccec-7d3f-4bb2-8994-9eb683ea4149 tempest-TestShelveInstance-1993482088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.051s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd15cda-5b1a-4b4c-be17-3e05db4780a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b840303f-96d8-4b7c-ab2f-97bf63228649', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b03246-7538-4811-801a-7ba3ff67b1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-6b99a531-a66e-48b3-8c61-b5de746938e6 req-c8b9ccec-7d3f-4bb2-8994-9eb683ea4149 tempest-TestShelveInstance-1993482088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.061s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:29 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Volume volume-b840303f-96d8-4b7c-ab2f-97bf63228649 (b840303f-96d8-4b7c-ab2f-97bf63228649): created successfully
Sep 28 18:13:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b03246-7538-4811-801a-7ba3ff67b1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Flow 'volume_create_manager' (ce31de1e-5e09-446b-baf9-4258cdfcb978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:13:29 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-06440f42-9a8b-4a88-9bae-00f66fdddaeb tempest-AttachVolumeNegativeTest-1944680203 None] Created volume successfully.
Sep 28 18:13:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-6b99a531-a66e-48b3-8c61-b5de746938e6 req-c8b9ccec-7d3f-4bb2-8994-9eb683ea4149 tempest-TestShelveInstance-1993482088 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-66b94401-2176-4ddc-92a7-b4fa1139e872', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9447ad2-a961-4509-bf22-687c3fc17095', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:13:29 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a95ac555-dc95-4fea-96a2-ca9b71faf3d6 tempest-GroupsV314Test-1779137991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0" returned: 0 in 0.710s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:29 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a95ac555-dc95-4fea-96a2-ca9b71faf3d6 tempest-GroupsV314Test-1779137991 None] Lock "cinder-quobyte-2a8e20e6-13f3-4532-af9d-02c2c6e3e6b0" released by "delete_volume" :: held 1.699s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:13:29 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-6b99a531-a66e-48b3-8c61-b5de746938e6 req-c8b9ccec-7d3f-4bb2-8994-9eb683ea4149 tempest-TestShelveInstance-1993482088 None] attachment_update completed successfully.
Sep 28 18:13:29 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-a95ac555-dc95-4fea-96a2-ca9b71faf3d6 tempest-GroupsV314Test-1779137991 None] Created reservations ['7bf715f0-58ed-42b3-aeba-3d9b8d572aae'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:13:29 devstack cinder-volume[87046]: WARNING cinder.quota [None req-a95ac555-dc95-4fea-96a2-ca9b71faf3d6 tempest-GroupsV314Test-1779137991 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-833913222 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-833913222, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:13:29 devstack cinder-volume[87046]: WARNING cinder.quota [None req-a95ac555-dc95-4fea-96a2-ca9b71faf3d6 tempest-GroupsV314Test-1779137991 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-833913222 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-833913222, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:13:30 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-a95ac555-dc95-4fea-96a2-ca9b71faf3d6 tempest-GroupsV314Test-1779137991 None] Created reservations ['4134c43a-b0d1-405c-90fa-9ab0fad38fa2', 'dab84fa1-0a76-440e-a5bc-426cb83abc9e', '8d6f028a-a1a8-4971-8501-7ade89acf4b8', '079c5a93-560a-4e55-b927-2952923ac594'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:13:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a95ac555-dc95-4fea-96a2-ca9b71faf3d6 tempest-GroupsV314Test-1779137991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a95ac555-dc95-4fea-96a2-ca9b71faf3d6 tempest-GroupsV314Test-1779137991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a95ac555-dc95-4fea-96a2-ca9b71faf3d6 tempest-GroupsV314Test-1779137991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:13:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a95ac555-dc95-4fea-96a2-ca9b71faf3d6 tempest-GroupsV314Test-1779137991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:13:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a95ac555-dc95-4fea-96a2-ca9b71faf3d6 tempest-GroupsV314Test-1779137991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a95ac555-dc95-4fea-96a2-ca9b71faf3d6 tempest-GroupsV314Test-1779137991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:30 devstack sudo[97092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:13:30 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:30 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a95ac555-dc95-4fea-96a2-ca9b71faf3d6 tempest-GroupsV314Test-1779137991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.681s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:30 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-a95ac555-dc95-4fea-96a2-ca9b71faf3d6 tempest-GroupsV314Test-1779137991 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:13:30 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-a95ac555-dc95-4fea-96a2-ca9b71faf3d6 tempest-GroupsV314Test-1779137991 None] Delete group completed successfully.
Sep 28 18:13:31 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-15fde6ab-7cb8-4573-a96d-1152cbc853f8 tempest-VolumesActionsTest-912461534 None] Terminate volume connection completed successfully.
Sep 28 18:13:31 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-15fde6ab-7cb8-4573-a96d-1152cbc853f8 tempest-VolumesActionsTest-912461534 None] Acquiring lock "cinder-0e9ddc80-c59b-458d-977a-a3ff80358c8c-detach_volume" by "detach_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:13:31 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-15fde6ab-7cb8-4573-a96d-1152cbc853f8 tempest-VolumesActionsTest-912461534 None] Lock "cinder-0e9ddc80-c59b-458d-977a-a3ff80358c8c-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:13:31 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-15fde6ab-7cb8-4573-a96d-1152cbc853f8 tempest-VolumesActionsTest-912461534 None] Detaching volume 0e9ddc80-c59b-458d-977a-a3ff80358c8c from instance 7cd73bb0-2ca0-489b-9225-d4a3e91e5ef9.
Sep 28 18:13:31 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-15fde6ab-7cb8-4573-a96d-1152cbc853f8 tempest-VolumesActionsTest-912461534 None] Detach volume completed successfully.
Sep 28 18:13:31 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-15fde6ab-7cb8-4573-a96d-1152cbc853f8 tempest-VolumesActionsTest-912461534 None] Lock "cinder-0e9ddc80-c59b-458d-977a-a3ff80358c8c-detach_volume" released by "detach_volume" :: held 0.196s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:13:31 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4d276fe5-f6ab-44ce-8abe-214143347f19 tempest-GroupsV314Test-1779137991 None] Acquiring lock "cinder-quobyte-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:13:31 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4d276fe5-f6ab-44ce-8abe-214143347f19 tempest-GroupsV314Test-1779137991 None] Lock "cinder-quobyte-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd" acquired by "delete_volume" :: waited 0.038s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:13:31 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[06df46b9-7dfb-400b-8dc7-dc8880e93c35]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:13:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4d276fe5-f6ab-44ce-8abe-214143347f19 tempest-GroupsV314Test-1779137991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:31 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-33403e91-dcc7-4c52-b6a7-866b0678b134 tempest-VolumesActionsTest-917175075 None] Acquiring lock "cinder-0e9ddc80-c59b-458d-977a-a3ff80358c8c-detach_volume" by "detach_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:13:31 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-33403e91-dcc7-4c52-b6a7-866b0678b134 tempest-VolumesActionsTest-917175075 None] Lock "cinder-0e9ddc80-c59b-458d-977a-a3ff80358c8c-detach_volume" acquired by "detach_volume" :: waited 0.050s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:13:31 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-33403e91-dcc7-4c52-b6a7-866b0678b134 tempest-VolumesActionsTest-917175075 None] Volume detach called, but volume not attached.
Sep 28 18:13:31 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-33403e91-dcc7-4c52-b6a7-866b0678b134 tempest-VolumesActionsTest-917175075 None] Lock "cinder-0e9ddc80-c59b-458d-977a-a3ff80358c8c-detach_volume" released by "detach_volume" :: held 0.055s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:13:32 devstack sudo[97102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd
Sep 28 18:13:32 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-4463ee7f-0d0c-4c5a-ad18-50ff80a4f070 req-6cc98e42-b61c-4a6d-a819-7a40f9ca504f tempest-AttachVolumeNegativeTest-1944680203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-4463ee7f-0d0c-4c5a-ad18-50ff80a4f070 req-6cc98e42-b61c-4a6d-a819-7a40f9ca504f tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-4463ee7f-0d0c-4c5a-ad18-50ff80a4f070 req-6cc98e42-b61c-4a6d-a819-7a40f9ca504f tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-4463ee7f-0d0c-4c5a-ad18-50ff80a4f070 req-6cc98e42-b61c-4a6d-a819-7a40f9ca504f tempest-AttachVolumeNegativeTest-1944680203 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-b840303f-96d8-4b7c-ab2f-97bf63228649', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a364b38-f731-47e1-8575-17f2e9d7e0b0', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:13:32 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1e01e0fc-8664-473b-975b-ce4c35473d71 tempest-VolumesActionsTest-917175075 None] Acquiring lock "cinder-0e9ddc80-c59b-458d-977a-a3ff80358c8c-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:13:32 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1e01e0fc-8664-473b-975b-ce4c35473d71 tempest-VolumesActionsTest-917175075 None] Lock "cinder-0e9ddc80-c59b-458d-977a-a3ff80358c8c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:13:32 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1e01e0fc-8664-473b-975b-ce4c35473d71 tempest-VolumesActionsTest-917175075 None] Acquiring lock "cinder-quobyte-0e9ddc80-c59b-458d-977a-a3ff80358c8c" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:13:32 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-4463ee7f-0d0c-4c5a-ad18-50ff80a4f070 req-6cc98e42-b61c-4a6d-a819-7a40f9ca504f tempest-AttachVolumeNegativeTest-1944680203 None] attachment_update completed successfully.
Sep 28 18:13:32 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1e01e0fc-8664-473b-975b-ce4c35473d71 tempest-VolumesActionsTest-917175075 None] Lock "cinder-quobyte-0e9ddc80-c59b-458d-977a-a3ff80358c8c" acquired by "delete_volume" :: waited 0.052s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:13:32 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[429845e7-f92c-43c1-9302-9a9c9d923de6]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:13:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1e01e0fc-8664-473b-975b-ce4c35473d71 tempest-VolumesActionsTest-917175075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e9ddc80-c59b-458d-977a-a3ff80358c8c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:32 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4d276fe5-f6ab-44ce-8abe-214143347f19 tempest-GroupsV314Test-1779137991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd" returned: 0 in 0.950s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4d276fe5-f6ab-44ce-8abe-214143347f19 tempest-GroupsV314Test-1779137991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:32 devstack sudo[97118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd
Sep 28 18:13:32 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:33 devstack sudo[97110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e9ddc80-c59b-458d-977a-a3ff80358c8c
Sep 28 18:13:33 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:33 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4d276fe5-f6ab-44ce-8abe-214143347f19 tempest-GroupsV314Test-1779137991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd" returned: 0 in 0.637s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:33 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4d276fe5-f6ab-44ce-8abe-214143347f19 tempest-GroupsV314Test-1779137991 None] Lock "cinder-quobyte-f93322a9-cebb-4987-9dfd-2b77a7a1d7bd" released by "delete_volume" :: held 1.735s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:13:33 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-4d276fe5-f6ab-44ce-8abe-214143347f19 tempest-GroupsV314Test-1779137991 None] Created reservations ['015616b7-6a6c-461c-9559-8252bcc0f978'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:13:33 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1e01e0fc-8664-473b-975b-ce4c35473d71 tempest-VolumesActionsTest-917175075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e9ddc80-c59b-458d-977a-a3ff80358c8c" returned: 0 in 0.889s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1e01e0fc-8664-473b-975b-ce4c35473d71 tempest-VolumesActionsTest-917175075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e9ddc80-c59b-458d-977a-a3ff80358c8c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:33 devstack sudo[97554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e9ddc80-c59b-458d-977a-a3ff80358c8c
Sep 28 18:13:33 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:33 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-4d276fe5-f6ab-44ce-8abe-214143347f19 tempest-GroupsV314Test-1779137991 None] Created reservations ['8ee92c5a-1cd0-4aa1-8008-b35db1e87104', '564fa347-518f-4cdd-8019-39b589a4046a', '68d4638a-e75f-4295-9124-5a7c2f6b5e17', '075b2f26-18d1-455d-94cb-efc5d705f0ca'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:13:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-4d276fe5-f6ab-44ce-8abe-214143347f19 tempest-GroupsV314Test-1779137991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-4d276fe5-f6ab-44ce-8abe-214143347f19 tempest-GroupsV314Test-1779137991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-4d276fe5-f6ab-44ce-8abe-214143347f19 tempest-GroupsV314Test-1779137991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:13:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-4d276fe5-f6ab-44ce-8abe-214143347f19 tempest-GroupsV314Test-1779137991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:13:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-4d276fe5-f6ab-44ce-8abe-214143347f19 tempest-GroupsV314Test-1779137991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4d276fe5-f6ab-44ce-8abe-214143347f19 tempest-GroupsV314Test-1779137991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:33 devstack sudo[97558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:13:33 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:34 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1e01e0fc-8664-473b-975b-ce4c35473d71 tempest-VolumesActionsTest-917175075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e9ddc80-c59b-458d-977a-a3ff80358c8c" returned: 0 in 0.461s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:34 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1e01e0fc-8664-473b-975b-ce4c35473d71 tempest-VolumesActionsTest-917175075 None] Lock "cinder-quobyte-0e9ddc80-c59b-458d-977a-a3ff80358c8c" released by "delete_volume" :: held 1.465s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:13:34 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-1e01e0fc-8664-473b-975b-ce4c35473d71 tempest-VolumesActionsTest-917175075 None] Created reservations ['6921c46f-f4e2-4cb0-ac93-358a91038b61', 'c29407b9-e9a0-4c1c-b5e1-13156afb0f55', 'c0b7905d-8748-4831-894a-0240a305ae18', '92befc4e-493e-40fe-8a25-54337a8445c0'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:13:34 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4d276fe5-f6ab-44ce-8abe-214143347f19 tempest-GroupsV314Test-1779137991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.438s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:34 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-4d276fe5-f6ab-44ce-8abe-214143347f19 tempest-GroupsV314Test-1779137991 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:13:34 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-4d276fe5-f6ab-44ce-8abe-214143347f19 tempest-GroupsV314Test-1779137991 None] Delete group completed successfully.
Sep 28 18:13:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1e01e0fc-8664-473b-975b-ce4c35473d71 tempest-VolumesActionsTest-917175075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1e01e0fc-8664-473b-975b-ce4c35473d71 tempest-VolumesActionsTest-917175075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:34 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1e01e0fc-8664-473b-975b-ce4c35473d71 tempest-VolumesActionsTest-917175075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:13:34 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1e01e0fc-8664-473b-975b-ce4c35473d71 tempest-VolumesActionsTest-917175075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:13:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1e01e0fc-8664-473b-975b-ce4c35473d71 tempest-VolumesActionsTest-917175075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1e01e0fc-8664-473b-975b-ce4c35473d71 tempest-VolumesActionsTest-917175075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:34 devstack sudo[97562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:13:34 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:35 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1e01e0fc-8664-473b-975b-ce4c35473d71 tempest-VolumesActionsTest-917175075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.674s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:35 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-1e01e0fc-8664-473b-975b-ce4c35473d71 tempest-VolumesActionsTest-917175075 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:13:35 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-1e01e0fc-8664-473b-975b-ce4c35473d71 tempest-VolumesActionsTest-917175075 None] Deleted volume successfully.
Sep 28 18:13:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1e01e0fc-8664-473b-975b-ce4c35473d71 tempest-VolumesActionsTest-917175075 None] Lock "cinder-0e9ddc80-c59b-458d-977a-a3ff80358c8c-delete_volume" released by "delete_volume" :: held 2.707s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:13:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:13:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:13:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:13:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:39 devstack sudo[97668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:13:39 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:39 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.606s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Flow 'volume_create_manager' (7e1075c7-8cb8-4627-b013-17bc273d8356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c9a54d3-d77d-4324-8167-640eb5bb014e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c9a54d3-d77d-4324-8167-640eb5bb014e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1558474403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37178d12-2330-469e-a5db-481c235b49c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18da014b7334309a1065e21232ae2e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:41Z,use_quota=True,user_id='b517be55405d43f5b4c5bc92568a6bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf026ab-7a44-42a3-9971-b2d08c4d80c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf026ab-7a44-42a3-9971-b2d08c4d80c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76949447-4973-4794-ace6-120a2e49e5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76949447-4973-4794-ace6-120a2e49e5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37178d12-2330-469e-a5db-481c235b49c0', 'volume_name': 'volume-37178d12-2330-469e-a5db-481c235b49c0', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2fc9f1-9589-434b-8214-16cd4efbf6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2fc9f1-9589-434b-8214-16cd4efbf6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4384c06-cc2f-43c9-9080-15b175a1e16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:40 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Volume 37178d12-2330-469e-a5db-481c235b49c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37178d12-2330-469e-a5db-481c235b49c0', 'volume_size': 1}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1558474403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37178d12-2330-469e-a5db-481c235b49c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18da014b7334309a1065e21232ae2e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:41Z,use_quota=True,user_id='b517be55405d43f5b4c5bc92568a6bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Creating volume 37178d12-2330-469e-a5db-481c235b49c0 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:13:40 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:13:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-37178d12-2330-469e-a5db-481c235b49c0 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:40 devstack sudo[97672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-37178d12-2330-469e-a5db-481c235b49c0 1073741824
Sep 28 18:13:40 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:41 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-37178d12-2330-469e-a5db-481c235b49c0 1073741824" returned: 0 in 0.726s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-37178d12-2330-469e-a5db-481c235b49c0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:41 devstack sudo[97677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-37178d12-2330-469e-a5db-481c235b49c0
Sep 28 18:13:41 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:42 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-37178d12-2330-469e-a5db-481c235b49c0" returned: 0 in 0.467s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:13:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4384c06-cc2f-43c9-9080-15b175a1e16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37178d12-2330-469e-a5db-481c235b49c0', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec879f31-694e-4c61-aaeb-d1e52f895d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:42 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Volume volume-37178d12-2330-469e-a5db-481c235b49c0 (37178d12-2330-469e-a5db-481c235b49c0): created successfully
Sep 28 18:13:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec879f31-694e-4c61-aaeb-d1e52f895d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Flow 'volume_create_manager' (7e1075c7-8cb8-4627-b013-17bc273d8356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:13:42 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-ace21f06-1dbb-475e-9720-2360e28f9448 tempest-VolumesActionsTest-917175075 None] Created volume successfully.
Sep 28 18:13:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-76bb41b8-2a33-4dd5-8784-e05dfdbdc735 tempest-VolumesActionsTest-912461534 None] Acquiring lock "cinder-37178d12-2330-469e-a5db-481c235b49c0-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:13:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-76bb41b8-2a33-4dd5-8784-e05dfdbdc735 tempest-VolumesActionsTest-912461534 None] Lock "cinder-37178d12-2330-469e-a5db-481c235b49c0-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:13:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-76bb41b8-2a33-4dd5-8784-e05dfdbdc735 tempest-VolumesActionsTest-912461534 None] Acquiring lock "cinder-quobyte-37178d12-2330-469e-a5db-481c235b49c0" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:13:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-76bb41b8-2a33-4dd5-8784-e05dfdbdc735 tempest-VolumesActionsTest-912461534 None] Lock "cinder-quobyte-37178d12-2330-469e-a5db-481c235b49c0" acquired by "delete_volume" :: waited 0.034s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:13:43 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[011c0ff5-aca3-4cab-a86f-a1ed66d08185]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:13:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-76bb41b8-2a33-4dd5-8784-e05dfdbdc735 tempest-VolumesActionsTest-912461534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-37178d12-2330-469e-a5db-481c235b49c0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:43 devstack sudo[97684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-37178d12-2330-469e-a5db-481c235b49c0
Sep 28 18:13:43 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:44 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-76bb41b8-2a33-4dd5-8784-e05dfdbdc735 tempest-VolumesActionsTest-912461534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-37178d12-2330-469e-a5db-481c235b49c0" returned: 0 in 0.647s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-76bb41b8-2a33-4dd5-8784-e05dfdbdc735 tempest-VolumesActionsTest-912461534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-37178d12-2330-469e-a5db-481c235b49c0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:44 devstack sudo[97689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-37178d12-2330-469e-a5db-481c235b49c0
Sep 28 18:13:44 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:44 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-76bb41b8-2a33-4dd5-8784-e05dfdbdc735 tempest-VolumesActionsTest-912461534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-37178d12-2330-469e-a5db-481c235b49c0" returned: 0 in 0.594s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-76bb41b8-2a33-4dd5-8784-e05dfdbdc735 tempest-VolumesActionsTest-912461534 None] Lock "cinder-quobyte-37178d12-2330-469e-a5db-481c235b49c0" released by "delete_volume" :: held 1.325s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:13:44 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-76bb41b8-2a33-4dd5-8784-e05dfdbdc735 tempest-VolumesActionsTest-912461534 None] Created reservations ['700b3efb-9a56-4295-93f7-61612b219260', '86e7a6a2-8097-4acd-a01f-ddc0e298bfbe', '9718c58c-ddf9-4621-8e27-47f836ebb71a', 'b7f21247-6b3a-4634-a2ec-60dcdfbf8df4'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:13:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-76bb41b8-2a33-4dd5-8784-e05dfdbdc735 tempest-VolumesActionsTest-912461534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-76bb41b8-2a33-4dd5-8784-e05dfdbdc735 tempest-VolumesActionsTest-912461534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-76bb41b8-2a33-4dd5-8784-e05dfdbdc735 tempest-VolumesActionsTest-912461534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:13:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-76bb41b8-2a33-4dd5-8784-e05dfdbdc735 tempest-VolumesActionsTest-912461534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:13:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-76bb41b8-2a33-4dd5-8784-e05dfdbdc735 tempest-VolumesActionsTest-912461534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-76bb41b8-2a33-4dd5-8784-e05dfdbdc735 tempest-VolumesActionsTest-912461534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:44 devstack sudo[97692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:13:44 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:45 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-76bb41b8-2a33-4dd5-8784-e05dfdbdc735 tempest-VolumesActionsTest-912461534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.452s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:45 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-76bb41b8-2a33-4dd5-8784-e05dfdbdc735 tempest-VolumesActionsTest-912461534 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:13:45 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-76bb41b8-2a33-4dd5-8784-e05dfdbdc735 tempest-VolumesActionsTest-912461534 None] Deleted volume successfully.
Sep 28 18:13:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-76bb41b8-2a33-4dd5-8784-e05dfdbdc735 tempest-VolumesActionsTest-912461534 None] Lock "cinder-37178d12-2330-469e-a5db-481c235b49c0-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:13:47 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:13:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Flow 'volume_create_manager' (34d3c497-0029-413a-b63f-46954308fda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:13:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777457ee-493c-46e4-a1aa-678c3107c5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777457ee-493c-46e4-a1aa-678c3107c5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-810161350',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f0e458d-3332-481f-aac3-84f87c7d70f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18da014b7334309a1065e21232ae2e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:47Z,use_quota=True,user_id='b517be55405d43f5b4c5bc92568a6bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2758c936-89ce-4e97-a425-87385dc23d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2758c936-89ce-4e97-a425-87385dc23d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384ebe95-c609-4fa9-a867-1e6766d0b292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384ebe95-c609-4fa9-a867-1e6766d0b292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f0e458d-3332-481f-aac3-84f87c7d70f9', 'volume_name': 'volume-1f0e458d-3332-481f-aac3-84f87c7d70f9', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9267666c-2b4b-40c9-822a-df55accc6d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9267666c-2b4b-40c9-822a-df55accc6d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984c6b4e-27ad-4e91-9a3b-f3e5fc1dc7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:47 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Volume 1f0e458d-3332-481f-aac3-84f87c7d70f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f0e458d-3332-481f-aac3-84f87c7d70f9', 'volume_size': 1}
Sep 28 18:13:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-810161350',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f0e458d-3332-481f-aac3-84f87c7d70f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18da014b7334309a1065e21232ae2e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:47Z,use_quota=True,user_id='b517be55405d43f5b4c5bc92568a6bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:13:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Creating volume 1f0e458d-3332-481f-aac3-84f87c7d70f9 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:13:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:13:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:13:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:13:47 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:13:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f0e458d-3332-481f-aac3-84f87c7d70f9 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:47 devstack sudo[97712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f0e458d-3332-481f-aac3-84f87c7d70f9 1073741824
Sep 28 18:13:47 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:48 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f0e458d-3332-481f-aac3-84f87c7d70f9 1073741824" returned: 0 in 0.773s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f0e458d-3332-481f-aac3-84f87c7d70f9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:48 devstack sudo[97717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f0e458d-3332-481f-aac3-84f87c7d70f9
Sep 28 18:13:48 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:48 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f0e458d-3332-481f-aac3-84f87c7d70f9" returned: 0 in 0.400s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:48 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:13:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984c6b4e-27ad-4e91-9a3b-f3e5fc1dc7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f0e458d-3332-481f-aac3-84f87c7d70f9', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53dbe8ab-dabe-43a6-a22e-f80a1c6ac988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:48 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Volume volume-1f0e458d-3332-481f-aac3-84f87c7d70f9 (1f0e458d-3332-481f-aac3-84f87c7d70f9): created successfully
Sep 28 18:13:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53dbe8ab-dabe-43a6-a22e-f80a1c6ac988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Flow 'volume_create_manager' (34d3c497-0029-413a-b63f-46954308fda7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:13:48 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-a1f5e1f8-251c-4d01-b90a-697abee066d1 tempest-VolumesActionsTest-917175075 None] Created volume successfully.
Sep 28 18:13:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e37ad3f5-3ec1-494f-933c-269739e523c9 tempest-VolumesActionsTest-912461534 None] Acquiring lock "cinder-1f0e458d-3332-481f-aac3-84f87c7d70f9-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:13:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e37ad3f5-3ec1-494f-933c-269739e523c9 tempest-VolumesActionsTest-912461534 None] Lock "cinder-1f0e458d-3332-481f-aac3-84f87c7d70f9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:13:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e37ad3f5-3ec1-494f-933c-269739e523c9 tempest-VolumesActionsTest-912461534 None] Acquiring lock "cinder-quobyte-1f0e458d-3332-481f-aac3-84f87c7d70f9" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:13:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e37ad3f5-3ec1-494f-933c-269739e523c9 tempest-VolumesActionsTest-912461534 None] Lock "cinder-quobyte-1f0e458d-3332-481f-aac3-84f87c7d70f9" acquired by "delete_volume" :: waited 0.044s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:13:49 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b099ab8a-10a1-49d2-a90c-f09390cb81d6]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:13:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e37ad3f5-3ec1-494f-933c-269739e523c9 tempest-VolumesActionsTest-912461534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f0e458d-3332-481f-aac3-84f87c7d70f9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:49 devstack sudo[97721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f0e458d-3332-481f-aac3-84f87c7d70f9
Sep 28 18:13:49 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e37ad3f5-3ec1-494f-933c-269739e523c9 tempest-VolumesActionsTest-912461534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f0e458d-3332-481f-aac3-84f87c7d70f9" returned: 0 in 0.726s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e37ad3f5-3ec1-494f-933c-269739e523c9 tempest-VolumesActionsTest-912461534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f0e458d-3332-481f-aac3-84f87c7d70f9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:50 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:50 devstack sudo[97726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f0e458d-3332-481f-aac3-84f87c7d70f9
Sep 28 18:13:50 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:51 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e37ad3f5-3ec1-494f-933c-269739e523c9 tempest-VolumesActionsTest-912461534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f0e458d-3332-481f-aac3-84f87c7d70f9" returned: 0 in 1.235s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e37ad3f5-3ec1-494f-933c-269739e523c9 tempest-VolumesActionsTest-912461534 None] Lock "cinder-quobyte-1f0e458d-3332-481f-aac3-84f87c7d70f9" released by "delete_volume" :: held 2.042s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:13:51 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-e37ad3f5-3ec1-494f-933c-269739e523c9 tempest-VolumesActionsTest-912461534 None] Created reservations ['5b6389da-02c3-4fa3-a529-1b395a7c7516', 'f83cefd3-af77-4987-abe3-2721ffa76db5', '120c4be9-f2f4-49a9-9609-479b25965502', 'fb00ae15-40de-4df6-85e0-9046a208b83d'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:13:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e37ad3f5-3ec1-494f-933c-269739e523c9 tempest-VolumesActionsTest-912461534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e37ad3f5-3ec1-494f-933c-269739e523c9 tempest-VolumesActionsTest-912461534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e37ad3f5-3ec1-494f-933c-269739e523c9 tempest-VolumesActionsTest-912461534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:13:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e37ad3f5-3ec1-494f-933c-269739e523c9 tempest-VolumesActionsTest-912461534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:13:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e37ad3f5-3ec1-494f-933c-269739e523c9 tempest-VolumesActionsTest-912461534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e37ad3f5-3ec1-494f-933c-269739e523c9 tempest-VolumesActionsTest-912461534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:52 devstack sudo[97760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:13:52 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:52 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e37ad3f5-3ec1-494f-933c-269739e523c9 tempest-VolumesActionsTest-912461534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.888s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:52 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-e37ad3f5-3ec1-494f-933c-269739e523c9 tempest-VolumesActionsTest-912461534 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:13:52 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-e37ad3f5-3ec1-494f-933c-269739e523c9 tempest-VolumesActionsTest-912461534 None] Deleted volume successfully.
Sep 28 18:13:52 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e37ad3f5-3ec1-494f-933c-269739e523c9 tempest-VolumesActionsTest-912461534 None] Lock "cinder-1f0e458d-3332-481f-aac3-84f87c7d70f9-delete_volume" released by "delete_volume" :: held 3.545s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:13:53 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:13:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Flow 'volume_create_manager' (db35665a-9fd8-4d78-8583-ca314099fe3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:13:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d920b160-c288-4f1c-a8fd-16c38c233bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d920b160-c288-4f1c-a8fd-16c38c233bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-70431244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae9a237c-4b86-415c-8836-9b500524bf83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18da014b7334309a1065e21232ae2e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:53Z,use_quota=True,user_id='b517be55405d43f5b4c5bc92568a6bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b3302c-a711-48a4-b8d9-03f31164a160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b3302c-a711-48a4-b8d9-03f31164a160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c09c8d-c552-4c4b-9640-e68125c1898f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c09c8d-c552-4c4b-9640-e68125c1898f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae9a237c-4b86-415c-8836-9b500524bf83', 'volume_name': 'volume-ae9a237c-4b86-415c-8836-9b500524bf83', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81cbba19-6477-451f-a652-844dc4e91177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81cbba19-6477-451f-a652-844dc4e91177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b666b06c-f654-406f-a38d-9bf81e81381a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:53 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Volume ae9a237c-4b86-415c-8836-9b500524bf83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae9a237c-4b86-415c-8836-9b500524bf83', 'volume_size': 1}
Sep 28 18:13:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-70431244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae9a237c-4b86-415c-8836-9b500524bf83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18da014b7334309a1065e21232ae2e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:53Z,use_quota=True,user_id='b517be55405d43f5b4c5bc92568a6bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:13:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Creating volume ae9a237c-4b86-415c-8836-9b500524bf83 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:13:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:13:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:13:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:13:53 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:13:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae9a237c-4b86-415c-8836-9b500524bf83 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:53 devstack sudo[97814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae9a237c-4b86-415c-8836-9b500524bf83 1073741824
Sep 28 18:13:53 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:54 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae9a237c-4b86-415c-8836-9b500524bf83 1073741824" returned: 0 in 0.689s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae9a237c-4b86-415c-8836-9b500524bf83 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:54 devstack sudo[97820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae9a237c-4b86-415c-8836-9b500524bf83
Sep 28 18:13:54 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:54 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae9a237c-4b86-415c-8836-9b500524bf83" returned: 0 in 0.608s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:54 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:13:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b666b06c-f654-406f-a38d-9bf81e81381a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae9a237c-4b86-415c-8836-9b500524bf83', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd20046-176e-462a-b871-d4c2165925e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:54 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Volume volume-ae9a237c-4b86-415c-8836-9b500524bf83 (ae9a237c-4b86-415c-8836-9b500524bf83): created successfully
Sep 28 18:13:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd20046-176e-462a-b871-d4c2165925e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Flow 'volume_create_manager' (db35665a-9fd8-4d78-8583-ca314099fe3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:13:54 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-762480a8-fcd9-4c95-bd95-e14907da1e0d tempest-VolumesActionsTest-917175075 None] Created volume successfully.
Sep 28 18:13:55 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8fffb379-a5c8-4ace-823a-c92b06c34af7 tempest-VolumesActionsTest-912461534 None] Acquiring lock "cinder-ae9a237c-4b86-415c-8836-9b500524bf83-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:13:55 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8fffb379-a5c8-4ace-823a-c92b06c34af7 tempest-VolumesActionsTest-912461534 None] Lock "cinder-ae9a237c-4b86-415c-8836-9b500524bf83-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:13:55 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8fffb379-a5c8-4ace-823a-c92b06c34af7 tempest-VolumesActionsTest-912461534 None] Acquiring lock "cinder-quobyte-ae9a237c-4b86-415c-8836-9b500524bf83" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:13:55 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8fffb379-a5c8-4ace-823a-c92b06c34af7 tempest-VolumesActionsTest-912461534 None] Lock "cinder-quobyte-ae9a237c-4b86-415c-8836-9b500524bf83" acquired by "delete_volume" :: waited 0.032s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:13:55 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3e0f5a-131e-47c2-8030-1790c93d97eb]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:13:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8fffb379-a5c8-4ace-823a-c92b06c34af7 tempest-VolumesActionsTest-912461534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae9a237c-4b86-415c-8836-9b500524bf83 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:56 devstack sudo[97825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae9a237c-4b86-415c-8836-9b500524bf83
Sep 28 18:13:56 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:56 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8fffb379-a5c8-4ace-823a-c92b06c34af7 tempest-VolumesActionsTest-912461534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae9a237c-4b86-415c-8836-9b500524bf83" returned: 0 in 0.726s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8fffb379-a5c8-4ace-823a-c92b06c34af7 tempest-VolumesActionsTest-912461534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae9a237c-4b86-415c-8836-9b500524bf83 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:56 devstack sudo[97830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae9a237c-4b86-415c-8836-9b500524bf83
Sep 28 18:13:56 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:57 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8fffb379-a5c8-4ace-823a-c92b06c34af7 tempest-VolumesActionsTest-912461534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae9a237c-4b86-415c-8836-9b500524bf83" returned: 0 in 0.471s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8fffb379-a5c8-4ace-823a-c92b06c34af7 tempest-VolumesActionsTest-912461534 None] Lock "cinder-quobyte-ae9a237c-4b86-415c-8836-9b500524bf83" released by "delete_volume" :: held 1.291s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:13:57 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-8fffb379-a5c8-4ace-823a-c92b06c34af7 tempest-VolumesActionsTest-912461534 None] Created reservations ['ccd11354-f15a-4fb6-aaa6-d29b412e7d5f', '3e3f4360-1db8-4b43-b3f7-3d7735e021eb', '17d5f6ae-7170-4d72-b98e-6e301a9a3aaf', '0cb56b79-0da2-4b4b-80f8-25f83091b77c'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:13:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8fffb379-a5c8-4ace-823a-c92b06c34af7 tempest-VolumesActionsTest-912461534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8fffb379-a5c8-4ace-823a-c92b06c34af7 tempest-VolumesActionsTest-912461534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:57 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8fffb379-a5c8-4ace-823a-c92b06c34af7 tempest-VolumesActionsTest-912461534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:13:57 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8fffb379-a5c8-4ace-823a-c92b06c34af7 tempest-VolumesActionsTest-912461534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:13:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8fffb379-a5c8-4ace-823a-c92b06c34af7 tempest-VolumesActionsTest-912461534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8fffb379-a5c8-4ace-823a-c92b06c34af7 tempest-VolumesActionsTest-912461534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:57 devstack sudo[97836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:13:57 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:13:58 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root
Sep 28 18:13:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8fffb379-a5c8-4ace-823a-c92b06c34af7 tempest-VolumesActionsTest-912461534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.698s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:13:58 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-8fffb379-a5c8-4ace-823a-c92b06c34af7 tempest-VolumesActionsTest-912461534 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:13:58 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-8fffb379-a5c8-4ace-823a-c92b06c34af7 tempest-VolumesActionsTest-912461534 None] Deleted volume successfully.
Sep 28 18:13:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8fffb379-a5c8-4ace-823a-c92b06c34af7 tempest-VolumesActionsTest-912461534 None] Lock "cinder-ae9a237c-4b86-415c-8836-9b500524bf83-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:13:59 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:13:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Flow 'volume_create_manager' (1f60bfcc-ffe7-47ab-8cc9-b2950e04b3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:13:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dce5034-c755-4e04-8598-d8d11fcea411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dce5034-c755-4e04-8598-d8d11fcea411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1661385548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b11d0df-f534-4643-9f9c-8de0b358ae4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18da014b7334309a1065e21232ae2e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:59Z,use_quota=True,user_id='b517be55405d43f5b4c5bc92568a6bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc236c6-da73-4c8e-82b6-e837c25e69f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc236c6-da73-4c8e-82b6-e837c25e69f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b486248-bfb4-43f4-a6d2-e78e159c5fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b486248-bfb4-43f4-a6d2-e78e159c5fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b11d0df-f534-4643-9f9c-8de0b358ae4b', 'volume_name': 'volume-0b11d0df-f534-4643-9f9c-8de0b358ae4b', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (704bd3c1-727a-4dce-bd19-65dedf6899c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (704bd3c1-727a-4dce-bd19-65dedf6899c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:13:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164d2878-1b58-420f-922a-7f87ebeee638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:13:59 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Volume 0b11d0df-f534-4643-9f9c-8de0b358ae4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b11d0df-f534-4643-9f9c-8de0b358ae4b', 'volume_size': 1}
Sep 28 18:13:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1661385548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b11d0df-f534-4643-9f9c-8de0b358ae4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18da014b7334309a1065e21232ae2e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:59Z,use_quota=True,user_id='b517be55405d43f5b4c5bc92568a6bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:13:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Creating volume 0b11d0df-f534-4643-9f9c-8de0b358ae4b {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:13:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:13:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:13:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:13:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:13:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:13:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:13:59 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:13:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0b11d0df-f534-4643-9f9c-8de0b358ae4b 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:13:59 devstack sudo[97843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0b11d0df-f534-4643-9f9c-8de0b358ae4b 1073741824
Sep 28 18:13:59 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:00 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0b11d0df-f534-4643-9f9c-8de0b358ae4b 1073741824" returned: 0 in 0.817s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0b11d0df-f534-4643-9f9c-8de0b358ae4b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:00 devstack sudo[97855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0b11d0df-f534-4643-9f9c-8de0b358ae4b
Sep 28 18:14:00 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:00 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0b11d0df-f534-4643-9f9c-8de0b358ae4b" returned: 0 in 0.427s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:14:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164d2878-1b58-420f-922a-7f87ebeee638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b11d0df-f534-4643-9f9c-8de0b358ae4b', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedb2f5c-14b3-4ba2-a1b4-91c2eca01292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:00 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Volume volume-0b11d0df-f534-4643-9f9c-8de0b358ae4b (0b11d0df-f534-4643-9f9c-8de0b358ae4b): created successfully
Sep 28 18:14:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedb2f5c-14b3-4ba2-a1b4-91c2eca01292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Flow 'volume_create_manager' (1f60bfcc-ffe7-47ab-8cc9-b2950e04b3c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:14:01 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-6ad02215-4440-471a-ae5e-02fc9300051d tempest-VolumesActionsTest-917175075 None] Created volume successfully.
Sep 28 18:14:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1f883d1a-17fe-421f-9ebe-219bfa137b10 tempest-VolumesActionsTest-912461534 None] Acquiring lock "cinder-0b11d0df-f534-4643-9f9c-8de0b358ae4b-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:14:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1f883d1a-17fe-421f-9ebe-219bfa137b10 tempest-VolumesActionsTest-912461534 None] Lock "cinder-0b11d0df-f534-4643-9f9c-8de0b358ae4b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:14:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1f883d1a-17fe-421f-9ebe-219bfa137b10 tempest-VolumesActionsTest-912461534 None] Acquiring lock "cinder-quobyte-0b11d0df-f534-4643-9f9c-8de0b358ae4b" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:14:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1f883d1a-17fe-421f-9ebe-219bfa137b10 tempest-VolumesActionsTest-912461534 None] Lock "cinder-quobyte-0b11d0df-f534-4643-9f9c-8de0b358ae4b" acquired by "delete_volume" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:14:01 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd31421-4367-4990-8227-2b78557b275f]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:14:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1f883d1a-17fe-421f-9ebe-219bfa137b10 tempest-VolumesActionsTest-912461534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0b11d0df-f534-4643-9f9c-8de0b358ae4b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:02 devstack sudo[97858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0b11d0df-f534-4643-9f9c-8de0b358ae4b
Sep 28 18:14:02 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:02 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1f883d1a-17fe-421f-9ebe-219bfa137b10 tempest-VolumesActionsTest-912461534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0b11d0df-f534-4643-9f9c-8de0b358ae4b" returned: 0 in 0.653s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1f883d1a-17fe-421f-9ebe-219bfa137b10 tempest-VolumesActionsTest-912461534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0b11d0df-f534-4643-9f9c-8de0b358ae4b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:02 devstack sudo[97875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0b11d0df-f534-4643-9f9c-8de0b358ae4b
Sep 28 18:14:02 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:02 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1f883d1a-17fe-421f-9ebe-219bfa137b10 tempest-VolumesActionsTest-912461534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0b11d0df-f534-4643-9f9c-8de0b358ae4b" returned: 0 in 0.388s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:02 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1f883d1a-17fe-421f-9ebe-219bfa137b10 tempest-VolumesActionsTest-912461534 None] Lock "cinder-quobyte-0b11d0df-f534-4643-9f9c-8de0b358ae4b" released by "delete_volume" :: held 1.105s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:14:03 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-1f883d1a-17fe-421f-9ebe-219bfa137b10 tempest-VolumesActionsTest-912461534 None] Created reservations ['fec65646-ea65-49a6-9d64-9fea883f902a', 'e99af0f0-9c77-4561-b998-0df346d0d648', '66130a3e-7b1d-4bdf-a815-cc7b0403875f', '9e1c14dd-d1b0-438f-b60f-267651569252'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:14:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1f883d1a-17fe-421f-9ebe-219bfa137b10 tempest-VolumesActionsTest-912461534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1f883d1a-17fe-421f-9ebe-219bfa137b10 tempest-VolumesActionsTest-912461534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:03 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1f883d1a-17fe-421f-9ebe-219bfa137b10 tempest-VolumesActionsTest-912461534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:14:03 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1f883d1a-17fe-421f-9ebe-219bfa137b10 tempest-VolumesActionsTest-912461534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:14:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1f883d1a-17fe-421f-9ebe-219bfa137b10 tempest-VolumesActionsTest-912461534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1f883d1a-17fe-421f-9ebe-219bfa137b10 tempest-VolumesActionsTest-912461534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:03 devstack sudo[97885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:14:03 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:03 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1f883d1a-17fe-421f-9ebe-219bfa137b10 tempest-VolumesActionsTest-912461534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.438s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:03 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-1f883d1a-17fe-421f-9ebe-219bfa137b10 tempest-VolumesActionsTest-912461534 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:14:03 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-1f883d1a-17fe-421f-9ebe-219bfa137b10 tempest-VolumesActionsTest-912461534 None] Deleted volume successfully.
Sep 28 18:14:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1f883d1a-17fe-421f-9ebe-219bfa137b10 tempest-VolumesActionsTest-912461534 None] Lock "cinder-0b11d0df-f534-4643-9f9c-8de0b358ae4b-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:14:04 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:14:04 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Flow 'volume_create_manager' (f2e94736-0e76-4d64-9c1c-f375e7675f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:14:04 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad453365-7fee-4204-a547-4bb0ff05c379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad453365-7fee-4204-a547-4bb0ff05c379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1148868757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3f71db-4269-4e47-ad2d-885309c60d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18da014b7334309a1065e21232ae2e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:05Z,use_quota=True,user_id='b517be55405d43f5b4c5bc92568a6bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9e3691-a0df-4431-80a3-1330f20603dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9e3691-a0df-4431-80a3-1330f20603dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a07912-33ed-4139-89e8-14e16d91d327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a07912-33ed-4139-89e8-14e16d91d327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c3f71db-4269-4e47-ad2d-885309c60d27', 'volume_name': 'volume-9c3f71db-4269-4e47-ad2d-885309c60d27', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ac56ad-00a3-4cba-8fe4-512cc1d50e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ac56ad-00a3-4cba-8fe4-512cc1d50e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6b01fd-7c45-469a-bb55-c4f8161ea53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:05 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Volume 9c3f71db-4269-4e47-ad2d-885309c60d27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c3f71db-4269-4e47-ad2d-885309c60d27', 'volume_size': 1}
Sep 28 18:14:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1148868757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3f71db-4269-4e47-ad2d-885309c60d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18da014b7334309a1065e21232ae2e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:05Z,use_quota=True,user_id='b517be55405d43f5b4c5bc92568a6bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:14:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Creating volume 9c3f71db-4269-4e47-ad2d-885309c60d27 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:14:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:14:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:14:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:14:05 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:14:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c3f71db-4269-4e47-ad2d-885309c60d27 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:05 devstack sudo[97888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c3f71db-4269-4e47-ad2d-885309c60d27 1073741824
Sep 28 18:14:05 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:05 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c3f71db-4269-4e47-ad2d-885309c60d27 1073741824" returned: 0 in 0.712s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c3f71db-4269-4e47-ad2d-885309c60d27 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:05 devstack sudo[97894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c3f71db-4269-4e47-ad2d-885309c60d27
Sep 28 18:14:05 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:06 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c3f71db-4269-4e47-ad2d-885309c60d27" returned: 0 in 0.451s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:06 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:14:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6b01fd-7c45-469a-bb55-c4f8161ea53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c3f71db-4269-4e47-ad2d-885309c60d27', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99fc3c3f-b5c3-42d8-aacf-a6213906d99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:06 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Volume volume-9c3f71db-4269-4e47-ad2d-885309c60d27 (9c3f71db-4269-4e47-ad2d-885309c60d27): created successfully
Sep 28 18:14:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99fc3c3f-b5c3-42d8-aacf-a6213906d99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Flow 'volume_create_manager' (f2e94736-0e76-4d64-9c1c-f375e7675f43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:14:06 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-dbc9155e-e81e-4d2b-a200-11976b48bb61 tempest-VolumesActionsTest-917175075 None] Created volume successfully.
Sep 28 18:14:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d3bfc58a-68bd-410c-a5cb-de5f8bc4b39c tempest-VolumesActionsTest-917175075 None] Acquiring lock "cinder-9c3f71db-4269-4e47-ad2d-885309c60d27-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:14:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d3bfc58a-68bd-410c-a5cb-de5f8bc4b39c tempest-VolumesActionsTest-917175075 None] Lock "cinder-9c3f71db-4269-4e47-ad2d-885309c60d27-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:14:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d3bfc58a-68bd-410c-a5cb-de5f8bc4b39c tempest-VolumesActionsTest-917175075 None] Acquiring lock "cinder-quobyte-9c3f71db-4269-4e47-ad2d-885309c60d27" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:14:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d3bfc58a-68bd-410c-a5cb-de5f8bc4b39c tempest-VolumesActionsTest-917175075 None] Lock "cinder-quobyte-9c3f71db-4269-4e47-ad2d-885309c60d27" acquired by "delete_volume" :: waited 0.028s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:14:08 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd99cc3-be20-4df5-970d-56da29b156e6]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:14:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d3bfc58a-68bd-410c-a5cb-de5f8bc4b39c tempest-VolumesActionsTest-917175075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c3f71db-4269-4e47-ad2d-885309c60d27 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:08 devstack sudo[97897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c3f71db-4269-4e47-ad2d-885309c60d27
Sep 28 18:14:08 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:08 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d3bfc58a-68bd-410c-a5cb-de5f8bc4b39c tempest-VolumesActionsTest-917175075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c3f71db-4269-4e47-ad2d-885309c60d27" returned: 0 in 0.519s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d3bfc58a-68bd-410c-a5cb-de5f8bc4b39c tempest-VolumesActionsTest-917175075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c3f71db-4269-4e47-ad2d-885309c60d27 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:08 devstack sudo[97902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c3f71db-4269-4e47-ad2d-885309c60d27
Sep 28 18:14:08 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:09 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d3bfc58a-68bd-410c-a5cb-de5f8bc4b39c tempest-VolumesActionsTest-917175075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c3f71db-4269-4e47-ad2d-885309c60d27" returned: 0 in 0.407s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d3bfc58a-68bd-410c-a5cb-de5f8bc4b39c tempest-VolumesActionsTest-917175075 None] Lock "cinder-quobyte-9c3f71db-4269-4e47-ad2d-885309c60d27" released by "delete_volume" :: held 1.023s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:14:09 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-d3bfc58a-68bd-410c-a5cb-de5f8bc4b39c tempest-VolumesActionsTest-917175075 None] Created reservations ['cb080fc4-9bab-4a53-b6e2-aad5dd10c451', '53cd8daa-db10-4a16-a53c-b64db0cb0efd', '052af351-3e63-4981-859a-7109dbc8e47d', '6dc313b0-aa5c-409b-97d3-a8db452de0a3'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:14:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d3bfc58a-68bd-410c-a5cb-de5f8bc4b39c tempest-VolumesActionsTest-917175075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d3bfc58a-68bd-410c-a5cb-de5f8bc4b39c tempest-VolumesActionsTest-917175075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d3bfc58a-68bd-410c-a5cb-de5f8bc4b39c tempest-VolumesActionsTest-917175075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:14:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d3bfc58a-68bd-410c-a5cb-de5f8bc4b39c tempest-VolumesActionsTest-917175075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:14:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d3bfc58a-68bd-410c-a5cb-de5f8bc4b39c tempest-VolumesActionsTest-917175075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d3bfc58a-68bd-410c-a5cb-de5f8bc4b39c tempest-VolumesActionsTest-917175075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:09 devstack sudo[97923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:14:09 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:09 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d3bfc58a-68bd-410c-a5cb-de5f8bc4b39c tempest-VolumesActionsTest-917175075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.307s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:09 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d3bfc58a-68bd-410c-a5cb-de5f8bc4b39c tempest-VolumesActionsTest-917175075 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:14:09 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d3bfc58a-68bd-410c-a5cb-de5f8bc4b39c tempest-VolumesActionsTest-917175075 None] Deleted volume successfully.
Sep 28 18:14:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d3bfc58a-68bd-410c-a5cb-de5f8bc4b39c tempest-VolumesActionsTest-917175075 None] Lock "cinder-9c3f71db-4269-4e47-ad2d-885309c60d27-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:14:14 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:14:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Flow 'volume_create_manager' (e0aef85e-a33e-4f41-981c-eb5f3ee90b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:14:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9372c02c-6427-4d8b-bd19-d071eb5bdfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9372c02c-6427-4d8b-bd19-d071eb5bdfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1321974587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e5eff7-4ff7-4a90-83e7-5db6732640b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56d6298ec674bcc9f064020a46460c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:15Z,use_quota=True,user_id='b8b7f1db554b4a44a4865324d9f5d328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91a916ac-da8a-413c-9472-fba899fd0bf6),volume_type_id=91a916ac-da8a-413c-9472-fba899fd0bf6)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7af205a-a4a6-48e7-b2cf-2ddd8be5e241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7af205a-a4a6-48e7-b2cf-2ddd8be5e241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d909f7a-00b9-4597-8664-c3175dc541ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d909f7a-00b9-4597-8664-c3175dc541ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9e5eff7-4ff7-4a90-83e7-5db6732640b4', 'volume_name': 'volume-d9e5eff7-4ff7-4a90-83e7-5db6732640b4', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5134e2-e5d8-4a52-849e-da40f7ed27c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5134e2-e5d8-4a52-849e-da40f7ed27c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7ea201-87a3-4593-be14-5cc2a13c1468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:14 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Volume d9e5eff7-4ff7-4a90-83e7-5db6732640b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9e5eff7-4ff7-4a90-83e7-5db6732640b4', 'volume_size': 1}
Sep 28 18:14:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1321974587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e5eff7-4ff7-4a90-83e7-5db6732640b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56d6298ec674bcc9f064020a46460c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:15Z,use_quota=True,user_id='b8b7f1db554b4a44a4865324d9f5d328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91a916ac-da8a-413c-9472-fba899fd0bf6),volume_type_id=91a916ac-da8a-413c-9472-fba899fd0bf6)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:14:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Creating volume d9e5eff7-4ff7-4a90-83e7-5db6732640b4 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:14:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:14:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:14:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:14:14 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:14:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d9e5eff7-4ff7-4a90-83e7-5db6732640b4 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:14 devstack sudo[97928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d9e5eff7-4ff7-4a90-83e7-5db6732640b4 1073741824
Sep 28 18:14:14 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:15 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d9e5eff7-4ff7-4a90-83e7-5db6732640b4 1073741824" returned: 0 in 0.656s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d9e5eff7-4ff7-4a90-83e7-5db6732640b4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:15 devstack sudo[97933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d9e5eff7-4ff7-4a90-83e7-5db6732640b4
Sep 28 18:14:15 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:15 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d9e5eff7-4ff7-4a90-83e7-5db6732640b4" returned: 0 in 0.503s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:14:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7ea201-87a3-4593-be14-5cc2a13c1468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9e5eff7-4ff7-4a90-83e7-5db6732640b4', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b483f21-1b9e-4296-8579-ffad4543cb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:15 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Volume volume-d9e5eff7-4ff7-4a90-83e7-5db6732640b4 (d9e5eff7-4ff7-4a90-83e7-5db6732640b4): created successfully
Sep 28 18:14:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b483f21-1b9e-4296-8579-ffad4543cb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Flow 'volume_create_manager' (e0aef85e-a33e-4f41-981c-eb5f3ee90b67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:14:16 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-41ec2fb3-8b3f-4c40-8b22-e1e936957c28 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Created volume successfully.
Sep 28 18:14:17 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:UPDATE=102,cinder:SELECT=84,cinder:INSERT=19,cinder:DELETE=8 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:14:17 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=89,cinder:UPDATE=104,cinder:INSERT=25,cinder:DELETE=6 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:14:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6ca78800-e6a5-47ca-b849-da61a47f0493 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6ca78800-e6a5-47ca-b849-da61a47f0493 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6ca78800-e6a5-47ca-b849-da61a47f0493 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:14:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6ca78800-e6a5-47ca-b849-da61a47f0493 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:14:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6ca78800-e6a5-47ca-b849-da61a47f0493 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6ca78800-e6a5-47ca-b849-da61a47f0493 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:17 devstack sudo[97941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:14:17 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:17 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6ca78800-e6a5-47ca-b849-da61a47f0493 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.483s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:17 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-6ca78800-e6a5-47ca-b849-da61a47f0493 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:14:17 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-6ca78800-e6a5-47ca-b849-da61a47f0493 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Retype volume completed successfully.
Sep 28 18:14:18 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5016350e-f59d-4622-ad48-07d94f219a72 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Acquiring lock "cinder-d9e5eff7-4ff7-4a90-83e7-5db6732640b4-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:14:18 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5016350e-f59d-4622-ad48-07d94f219a72 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Lock "cinder-d9e5eff7-4ff7-4a90-83e7-5db6732640b4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:14:18 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5016350e-f59d-4622-ad48-07d94f219a72 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Acquiring lock "cinder-quobyte-d9e5eff7-4ff7-4a90-83e7-5db6732640b4" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:14:18 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5016350e-f59d-4622-ad48-07d94f219a72 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Lock "cinder-quobyte-d9e5eff7-4ff7-4a90-83e7-5db6732640b4" acquired by "delete_volume" :: waited 0.019s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:14:19 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85e3637-1ac6-42fa-a5a0-7ac00113c691]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:14:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5016350e-f59d-4622-ad48-07d94f219a72 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d9e5eff7-4ff7-4a90-83e7-5db6732640b4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:19 devstack sudo[97949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d9e5eff7-4ff7-4a90-83e7-5db6732640b4
Sep 28 18:14:19 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:19 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5016350e-f59d-4622-ad48-07d94f219a72 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d9e5eff7-4ff7-4a90-83e7-5db6732640b4" returned: 0 in 0.780s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5016350e-f59d-4622-ad48-07d94f219a72 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d9e5eff7-4ff7-4a90-83e7-5db6732640b4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:19 devstack sudo[97959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d9e5eff7-4ff7-4a90-83e7-5db6732640b4
Sep 28 18:14:19 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:20 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5016350e-f59d-4622-ad48-07d94f219a72 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d9e5eff7-4ff7-4a90-83e7-5db6732640b4" returned: 0 in 0.632s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:20 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5016350e-f59d-4622-ad48-07d94f219a72 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Lock "cinder-quobyte-d9e5eff7-4ff7-4a90-83e7-5db6732640b4" released by "delete_volume" :: held 1.526s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:14:20 devstack cinder-volume[87046]: WARNING cinder.quota [None req-5016350e-f59d-4622-ad48-07d94f219a72 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:14:20 devstack cinder-volume[87046]: WARNING cinder.quota [None req-5016350e-f59d-4622-ad48-07d94f219a72 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:14:20 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-5016350e-f59d-4622-ad48-07d94f219a72 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Created reservations ['ce6af95e-4020-4ee5-ac1e-d4d40bdcb184', 'ce7901e2-32f4-4b80-be02-90b50425b12c', '1e284ae1-f71f-4d24-bbeb-46072057021d', '918524af-f1f9-4a09-9898-a57e0885f808'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:14:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5016350e-f59d-4622-ad48-07d94f219a72 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5016350e-f59d-4622-ad48-07d94f219a72 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5016350e-f59d-4622-ad48-07d94f219a72 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:14:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5016350e-f59d-4622-ad48-07d94f219a72 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:14:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5016350e-f59d-4622-ad48-07d94f219a72 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5016350e-f59d-4622-ad48-07d94f219a72 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:20 devstack sudo[97984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:14:20 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:21 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5016350e-f59d-4622-ad48-07d94f219a72 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.582s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:21 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-5016350e-f59d-4622-ad48-07d94f219a72 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:14:21 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-5016350e-f59d-4622-ad48-07d94f219a72 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Deleted volume successfully.
Sep 28 18:14:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5016350e-f59d-4622-ad48-07d94f219a72 tempest-VolumeRetypeWithoutMigrationTest-565832102 None] Lock "cinder-d9e5eff7-4ff7-4a90-83e7-5db6732640b4-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:14:22 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-687d32bb-41f4-4a7f-9618-c75f30356216 req-693b904f-0ef2-4963-b8f8-dfef2a67a5c2 tempest-TestShelveInstance-1993482088 None] Terminate volume connection completed successfully.
Sep 28 18:14:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-687d32bb-41f4-4a7f-9618-c75f30356216 req-693b904f-0ef2-4963-b8f8-dfef2a67a5c2 tempest-TestShelveInstance-1993482088 None] Deleting attachment f9447ad2-a961-4509-bf22-687c3fc17095. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:14:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-687d32bb-41f4-4a7f-9618-c75f30356216 req-99082352-c9ef-40ac-98d1-39b90430fa92 tempest-TestShelveInstance-1993482088 None] Acquiring lock "cinder-66b94401-2176-4ddc-92a7-b4fa1139e872-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:14:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-687d32bb-41f4-4a7f-9618-c75f30356216 req-99082352-c9ef-40ac-98d1-39b90430fa92 tempest-TestShelveInstance-1993482088 None] Lock "cinder-66b94401-2176-4ddc-92a7-b4fa1139e872-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:14:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-687d32bb-41f4-4a7f-9618-c75f30356216 req-99082352-c9ef-40ac-98d1-39b90430fa92 tempest-TestShelveInstance-1993482088 None] Acquiring lock "cinder-quobyte-66b94401-2176-4ddc-92a7-b4fa1139e872" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:14:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-687d32bb-41f4-4a7f-9618-c75f30356216 req-99082352-c9ef-40ac-98d1-39b90430fa92 tempest-TestShelveInstance-1993482088 None] Lock "cinder-quobyte-66b94401-2176-4ddc-92a7-b4fa1139e872" acquired by "delete_volume" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:14:22 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e922eb-c93d-4ca5-9e74-d74371d9d1cc]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:14:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-687d32bb-41f4-4a7f-9618-c75f30356216 req-99082352-c9ef-40ac-98d1-39b90430fa92 tempest-TestShelveInstance-1993482088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-66b94401-2176-4ddc-92a7-b4fa1139e872 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:22 devstack sudo[98013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-66b94401-2176-4ddc-92a7-b4fa1139e872
Sep 28 18:14:22 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:23 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-687d32bb-41f4-4a7f-9618-c75f30356216 req-99082352-c9ef-40ac-98d1-39b90430fa92 tempest-TestShelveInstance-1993482088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-66b94401-2176-4ddc-92a7-b4fa1139e872" returned: 0 in 0.876s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-687d32bb-41f4-4a7f-9618-c75f30356216 req-99082352-c9ef-40ac-98d1-39b90430fa92 tempest-TestShelveInstance-1993482088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-66b94401-2176-4ddc-92a7-b4fa1139e872 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:23 devstack sudo[98055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-66b94401-2176-4ddc-92a7-b4fa1139e872
Sep 28 18:14:23 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:24 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-687d32bb-41f4-4a7f-9618-c75f30356216 req-99082352-c9ef-40ac-98d1-39b90430fa92 tempest-TestShelveInstance-1993482088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-66b94401-2176-4ddc-92a7-b4fa1139e872" returned: 0 in 0.510s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-687d32bb-41f4-4a7f-9618-c75f30356216 req-99082352-c9ef-40ac-98d1-39b90430fa92 tempest-TestShelveInstance-1993482088 None] Lock "cinder-quobyte-66b94401-2176-4ddc-92a7-b4fa1139e872" released by "delete_volume" :: held 1.482s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:14:24 devstack cinder-volume[87046]: DEBUG cinder.quota [req-687d32bb-41f4-4a7f-9618-c75f30356216 req-99082352-c9ef-40ac-98d1-39b90430fa92 tempest-TestShelveInstance-1993482088 None] Created reservations ['2559eab7-0a03-4bba-a9f8-5f496ff7f34a', '7f93812d-d5e6-4dbd-bf15-d95f8eb51a26', '382e2525-a541-4395-a1ef-bfeaa54e8df9', '6eb51a8b-4a98-4506-8af5-115413de2db7'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:14:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-687d32bb-41f4-4a7f-9618-c75f30356216 req-99082352-c9ef-40ac-98d1-39b90430fa92 tempest-TestShelveInstance-1993482088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-687d32bb-41f4-4a7f-9618-c75f30356216 req-99082352-c9ef-40ac-98d1-39b90430fa92 tempest-TestShelveInstance-1993482088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [req-687d32bb-41f4-4a7f-9618-c75f30356216 req-99082352-c9ef-40ac-98d1-39b90430fa92 tempest-TestShelveInstance-1993482088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:14:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [req-687d32bb-41f4-4a7f-9618-c75f30356216 req-99082352-c9ef-40ac-98d1-39b90430fa92 tempest-TestShelveInstance-1993482088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:14:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-687d32bb-41f4-4a7f-9618-c75f30356216 req-99082352-c9ef-40ac-98d1-39b90430fa92 tempest-TestShelveInstance-1993482088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-687d32bb-41f4-4a7f-9618-c75f30356216 req-99082352-c9ef-40ac-98d1-39b90430fa92 tempest-TestShelveInstance-1993482088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:24 devstack sudo[98061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:14:24 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:24 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [req-687d32bb-41f4-4a7f-9618-c75f30356216 req-99082352-c9ef-40ac-98d1-39b90430fa92 tempest-TestShelveInstance-1993482088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.351s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:24 devstack cinder-volume[87046]: DEBUG cinder.manager [req-687d32bb-41f4-4a7f-9618-c75f30356216 req-99082352-c9ef-40ac-98d1-39b90430fa92 tempest-TestShelveInstance-1993482088 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:14:24 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-687d32bb-41f4-4a7f-9618-c75f30356216 req-99082352-c9ef-40ac-98d1-39b90430fa92 tempest-TestShelveInstance-1993482088 None] Deleted volume successfully.
Sep 28 18:14:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [req-687d32bb-41f4-4a7f-9618-c75f30356216 req-99082352-c9ef-40ac-98d1-39b90430fa92 tempest-TestShelveInstance-1993482088 None] Lock "cinder-66b94401-2176-4ddc-92a7-b4fa1139e872-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:14:29 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-abff24bb-bdf8-413b-bd84-7346c833974d req-c0dd3572-3ad5-4f0d-bbd4-2df196309118 tempest-AttachVolumeNegativeTest-1944680203 None] Terminate volume connection completed successfully.
Sep 28 18:14:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-abff24bb-bdf8-413b-bd84-7346c833974d req-c0dd3572-3ad5-4f0d-bbd4-2df196309118 tempest-AttachVolumeNegativeTest-1944680203 None] Deleting attachment 4a364b38-f731-47e1-8575-17f2e9d7e0b0. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:14:36 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:14:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Flow 'volume_create_manager' (52db9093-0bf5-4518-8232-0784fd79a843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:14:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2c3e58-f0f8-441f-b7ec-176cb9b5ae05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2c3e58-f0f8-441f-b7ec-176cb9b5ae05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2019435609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe37262b-5e61-4758-981d-c4cb54177629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a10c510d09604cef920934e97bb96896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:36Z,use_quota=True,user_id='1466323f583c407e979e9bfca4e645cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7150d2e2-2e81-4502-894b-fcd0d9bb5333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7150d2e2-2e81-4502-894b-fcd0d9bb5333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c038e2-c4cc-472e-8795-52a37328e577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c038e2-c4cc-472e-8795-52a37328e577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe37262b-5e61-4758-981d-c4cb54177629', 'volume_name': 'volume-fe37262b-5e61-4758-981d-c4cb54177629', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa74f579-2473-4882-8d15-0ae960d8e38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa74f579-2473-4882-8d15-0ae960d8e38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e3ea89-7709-4993-99af-090684296c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:36 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Volume fe37262b-5e61-4758-981d-c4cb54177629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe37262b-5e61-4758-981d-c4cb54177629', 'volume_size': 1}
Sep 28 18:14:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2019435609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe37262b-5e61-4758-981d-c4cb54177629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a10c510d09604cef920934e97bb96896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:36Z,use_quota=True,user_id='1466323f583c407e979e9bfca4e645cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:14:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Creating volume fe37262b-5e61-4758-981d-c4cb54177629 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:14:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:14:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:14:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:14:36 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:14:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fe37262b-5e61-4758-981d-c4cb54177629 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:36 devstack sudo[98104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fe37262b-5e61-4758-981d-c4cb54177629 1073741824
Sep 28 18:14:36 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:37 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fe37262b-5e61-4758-981d-c4cb54177629 1073741824" returned: 0 in 0.696s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fe37262b-5e61-4758-981d-c4cb54177629 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:37 devstack sudo[98110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fe37262b-5e61-4758-981d-c4cb54177629
Sep 28 18:14:37 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:37 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fe37262b-5e61-4758-981d-c4cb54177629" returned: 0 in 0.337s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:14:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e3ea89-7709-4993-99af-090684296c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe37262b-5e61-4758-981d-c4cb54177629', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff87ab76-7308-451f-81ed-c82910c1ffff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:37 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Volume volume-fe37262b-5e61-4758-981d-c4cb54177629 (fe37262b-5e61-4758-981d-c4cb54177629): created successfully
Sep 28 18:14:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff87ab76-7308-451f-81ed-c82910c1ffff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Flow 'volume_create_manager' (52db9093-0bf5-4518-8232-0784fd79a843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:14:37 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-453f04e2-805f-43f0-b926-ae66b90f6317 tempest-VolumesListAdminTestJSON-1121941468 None] Created volume successfully.
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Flow 'volume_create_manager' (9ae3001a-cded-4823-a26e-20f3c7d20cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e971f8-eca6-4c20-8b73-5b90e7de0f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e971f8-eca6-4c20-8b73-5b90e7de0f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1185733063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aee9065-6b1d-4990-865a-eb1790831601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a10c510d09604cef920934e97bb96896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:39Z,use_quota=True,user_id='1466323f583c407e979e9bfca4e645cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5229ec7-29f8-404e-b8da-b70983caf52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5229ec7-29f8-404e-b8da-b70983caf52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d592d0e-540e-4e89-add1-9a8e60749421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d592d0e-540e-4e89-add1-9a8e60749421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aee9065-6b1d-4990-865a-eb1790831601', 'volume_name': 'volume-5aee9065-6b1d-4990-865a-eb1790831601', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60fe4fd-4aa9-422a-b982-c9f2ecfca689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60fe4fd-4aa9-422a-b982-c9f2ecfca689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d56d95-e9ff-4966-8b39-1bcc3c23290e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:39 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Volume 5aee9065-6b1d-4990-865a-eb1790831601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aee9065-6b1d-4990-865a-eb1790831601', 'volume_size': 1}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1185733063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aee9065-6b1d-4990-865a-eb1790831601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a10c510d09604cef920934e97bb96896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:39Z,use_quota=True,user_id='1466323f583c407e979e9bfca4e645cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Creating volume 5aee9065-6b1d-4990-865a-eb1790831601 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:14:39 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5aee9065-6b1d-4990-865a-eb1790831601 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:39 devstack sudo[98114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5aee9065-6b1d-4990-865a-eb1790831601 1073741824
Sep 28 18:14:39 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:39 devstack sudo[98115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:14:39 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:39 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.541s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:14:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:14:40 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5aee9065-6b1d-4990-865a-eb1790831601 1073741824" returned: 0 in 0.762s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5aee9065-6b1d-4990-865a-eb1790831601 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:40 devstack sudo[98123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5aee9065-6b1d-4990-865a-eb1790831601
Sep 28 18:14:40 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:40 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5aee9065-6b1d-4990-865a-eb1790831601" returned: 0 in 0.384s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:14:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d56d95-e9ff-4966-8b39-1bcc3c23290e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aee9065-6b1d-4990-865a-eb1790831601', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9faf5ae5-ebb6-4a37-9ed1-5e6cb411a9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:40 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Volume volume-5aee9065-6b1d-4990-865a-eb1790831601 (5aee9065-6b1d-4990-865a-eb1790831601): created successfully
Sep 28 18:14:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9faf5ae5-ebb6-4a37-9ed1-5e6cb411a9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Flow 'volume_create_manager' (9ae3001a-cded-4823-a26e-20f3c7d20cce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:14:40 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-0d9c33d8-b6b3-485b-a749-52ffcae76084 tempest-VolumesListAdminTestJSON-1121941468 None] Created volume successfully.
Sep 28 18:14:42 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:14:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Flow 'volume_create_manager' (3e0f21ca-b3cc-4fca-8268-14390096f181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:14:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6202c114-72e4-4e07-9020-3a4863168c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6202c114-72e4-4e07-9020-3a4863168c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1046122528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3187e28a-1839-4a61-beb4-c289c0807716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a10c510d09604cef920934e97bb96896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:42Z,use_quota=True,user_id='1466323f583c407e979e9bfca4e645cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cbadabc-a5f5-4633-829c-15c1c1342dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cbadabc-a5f5-4633-829c-15c1c1342dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e2da4b-5902-4822-9970-f28b76066781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e2da4b-5902-4822-9970-f28b76066781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3187e28a-1839-4a61-beb4-c289c0807716', 'volume_name': 'volume-3187e28a-1839-4a61-beb4-c289c0807716', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568c2e74-70c1-44a3-ae80-d5ef51c52054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568c2e74-70c1-44a3-ae80-d5ef51c52054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602bbebf-c03e-40db-b523-cd46c00a0e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:42 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Volume 3187e28a-1839-4a61-beb4-c289c0807716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3187e28a-1839-4a61-beb4-c289c0807716', 'volume_size': 1}
Sep 28 18:14:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1046122528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3187e28a-1839-4a61-beb4-c289c0807716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a10c510d09604cef920934e97bb96896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:42Z,use_quota=True,user_id='1466323f583c407e979e9bfca4e645cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:14:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Creating volume 3187e28a-1839-4a61-beb4-c289c0807716 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:14:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:14:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:14:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:14:42 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:14:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3187e28a-1839-4a61-beb4-c289c0807716 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:42 devstack sudo[98127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3187e28a-1839-4a61-beb4-c289c0807716 1073741824
Sep 28 18:14:42 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:43 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3187e28a-1839-4a61-beb4-c289c0807716 1073741824" returned: 0 in 0.801s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3187e28a-1839-4a61-beb4-c289c0807716 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:43 devstack sudo[98134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3187e28a-1839-4a61-beb4-c289c0807716
Sep 28 18:14:43 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:43 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3187e28a-1839-4a61-beb4-c289c0807716" returned: 0 in 0.414s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:14:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602bbebf-c03e-40db-b523-cd46c00a0e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3187e28a-1839-4a61-beb4-c289c0807716', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cc90ada-4179-4f2c-a17c-42c7fd7da9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:43 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Volume volume-3187e28a-1839-4a61-beb4-c289c0807716 (3187e28a-1839-4a61-beb4-c289c0807716): created successfully
Sep 28 18:14:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cc90ada-4179-4f2c-a17c-42c7fd7da9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Flow 'volume_create_manager' (3e0f21ca-b3cc-4fca-8268-14390096f181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:14:43 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-90a21747-367b-42c2-981c-d9a3bdce9e8a tempest-VolumesListAdminTestJSON-1121941468 None] Created volume successfully.
Sep 28 18:14:45 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:14:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Flow 'volume_create_manager' (7db7e966-0279-4e91-a6b3-9d23c51ca14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:14:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc3b63f-0751-48be-a0e9-2c6196555444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc3b63f-0751-48be-a0e9-2c6196555444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57fd6e0c-7251-48eb-9ecc-ccd07979482f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a687fa9a81480b96ea6bea9de27e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:46Z,use_quota=True,user_id='15f630c205b24a6787a22f757b413391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a64917e-632a-47e9-85d6-bc28616edee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a64917e-632a-47e9-85d6-bc28616edee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e32aa2-fba4-4061-942a-e8e9c9932c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e32aa2-fba4-4061-942a-e8e9c9932c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57fd6e0c-7251-48eb-9ecc-ccd07979482f', 'volume_name': 'volume-57fd6e0c-7251-48eb-9ecc-ccd07979482f', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27acb13-12c4-4781-a604-740fbb7eac57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27acb13-12c4-4781-a604-740fbb7eac57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcefd62a-906c-4f65-af8f-6ef8226167ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:45 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Volume 57fd6e0c-7251-48eb-9ecc-ccd07979482f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57fd6e0c-7251-48eb-9ecc-ccd07979482f', 'volume_size': 1}
Sep 28 18:14:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57fd6e0c-7251-48eb-9ecc-ccd07979482f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a687fa9a81480b96ea6bea9de27e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:46Z,use_quota=True,user_id='15f630c205b24a6787a22f757b413391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:14:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Creating volume 57fd6e0c-7251-48eb-9ecc-ccd07979482f {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:14:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:14:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:14:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:14:45 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:14:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57fd6e0c-7251-48eb-9ecc-ccd07979482f 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:46 devstack sudo[98137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57fd6e0c-7251-48eb-9ecc-ccd07979482f 1073741824
Sep 28 18:14:46 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:46 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57fd6e0c-7251-48eb-9ecc-ccd07979482f 1073741824" returned: 0 in 0.807s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57fd6e0c-7251-48eb-9ecc-ccd07979482f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:46 devstack sudo[98146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57fd6e0c-7251-48eb-9ecc-ccd07979482f
Sep 28 18:14:46 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:47 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57fd6e0c-7251-48eb-9ecc-ccd07979482f" returned: 0 in 0.434s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:14:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcefd62a-906c-4f65-af8f-6ef8226167ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57fd6e0c-7251-48eb-9ecc-ccd07979482f', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ffe993-14cd-428b-8d34-d92a75801b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:47 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Volume volume-57fd6e0c-7251-48eb-9ecc-ccd07979482f (57fd6e0c-7251-48eb-9ecc-ccd07979482f): created successfully
Sep 28 18:14:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ffe993-14cd-428b-8d34-d92a75801b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Flow 'volume_create_manager' (7db7e966-0279-4e91-a6b3-9d23c51ca14a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:14:47 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-3bed8bc2-1b2c-441f-9b05-c9db4bd57b7c tempest-VolumesListAdminTestJSON-1494599046 None] Created volume successfully.
Sep 28 18:14:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d83fd954-7f98-4e57-8b71-d358894cbf40 tempest-VolumesListAdminTestJSON-1494599046 None] Acquiring lock "cinder-57fd6e0c-7251-48eb-9ecc-ccd07979482f-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:14:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d83fd954-7f98-4e57-8b71-d358894cbf40 tempest-VolumesListAdminTestJSON-1494599046 None] Lock "cinder-57fd6e0c-7251-48eb-9ecc-ccd07979482f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:14:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d83fd954-7f98-4e57-8b71-d358894cbf40 tempest-VolumesListAdminTestJSON-1494599046 None] Acquiring lock "cinder-quobyte-57fd6e0c-7251-48eb-9ecc-ccd07979482f" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:14:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d83fd954-7f98-4e57-8b71-d358894cbf40 tempest-VolumesListAdminTestJSON-1494599046 None] Lock "cinder-quobyte-57fd6e0c-7251-48eb-9ecc-ccd07979482f" acquired by "delete_volume" :: waited 0.030s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:14:48 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d76fb9c-c09b-4442-8db0-a9b19a2d78ec]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:14:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d83fd954-7f98-4e57-8b71-d358894cbf40 tempest-VolumesListAdminTestJSON-1494599046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57fd6e0c-7251-48eb-9ecc-ccd07979482f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6b5fe829-012f-45db-b1db-3b5f8c11c73f tempest-VolumesListAdminTestJSON-1121941468 None] Acquiring lock "cinder-3187e28a-1839-4a61-beb4-c289c0807716-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:14:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6b5fe829-012f-45db-b1db-3b5f8c11c73f tempest-VolumesListAdminTestJSON-1121941468 None] Lock "cinder-3187e28a-1839-4a61-beb4-c289c0807716-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:14:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6b5fe829-012f-45db-b1db-3b5f8c11c73f tempest-VolumesListAdminTestJSON-1121941468 None] Acquiring lock "cinder-quobyte-3187e28a-1839-4a61-beb4-c289c0807716" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:14:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6b5fe829-012f-45db-b1db-3b5f8c11c73f tempest-VolumesListAdminTestJSON-1121941468 None] Lock "cinder-quobyte-3187e28a-1839-4a61-beb4-c289c0807716" acquired by "delete_volume" :: waited 0.033s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:14:48 devstack sudo[98149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57fd6e0c-7251-48eb-9ecc-ccd07979482f
Sep 28 18:14:48 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:48 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fad3330-bec4-4335-b228-34ae22acf639]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:14:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6b5fe829-012f-45db-b1db-3b5f8c11c73f tempest-VolumesListAdminTestJSON-1121941468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3187e28a-1839-4a61-beb4-c289c0807716 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:48 devstack sudo[98151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3187e28a-1839-4a61-beb4-c289c0807716
Sep 28 18:14:48 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:49 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d83fd954-7f98-4e57-8b71-d358894cbf40 tempest-VolumesListAdminTestJSON-1494599046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57fd6e0c-7251-48eb-9ecc-ccd07979482f" returned: 0 in 0.713s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d83fd954-7f98-4e57-8b71-d358894cbf40 tempest-VolumesListAdminTestJSON-1494599046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57fd6e0c-7251-48eb-9ecc-ccd07979482f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:49 devstack sudo[98163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57fd6e0c-7251-48eb-9ecc-ccd07979482f
Sep 28 18:14:49 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:49 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6b5fe829-012f-45db-b1db-3b5f8c11c73f tempest-VolumesListAdminTestJSON-1121941468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3187e28a-1839-4a61-beb4-c289c0807716" returned: 0 in 0.987s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6b5fe829-012f-45db-b1db-3b5f8c11c73f tempest-VolumesListAdminTestJSON-1121941468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3187e28a-1839-4a61-beb4-c289c0807716 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:49 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:49 devstack sudo[98176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3187e28a-1839-4a61-beb4-c289c0807716
Sep 28 18:14:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d83fd954-7f98-4e57-8b71-d358894cbf40 tempest-VolumesListAdminTestJSON-1494599046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57fd6e0c-7251-48eb-9ecc-ccd07979482f" returned: 0 in 0.630s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:49 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d83fd954-7f98-4e57-8b71-d358894cbf40 tempest-VolumesListAdminTestJSON-1494599046 None] Lock "cinder-quobyte-57fd6e0c-7251-48eb-9ecc-ccd07979482f" released by "delete_volume" :: held 1.455s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:14:49 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-d83fd954-7f98-4e57-8b71-d358894cbf40 tempest-VolumesListAdminTestJSON-1494599046 None] Created reservations ['32c599d7-ccc5-40bf-a276-ba16699758e4', '8cb62a83-e782-42e2-bdff-378178dd1c41', '633e23a1-101a-443e-aef4-edf636640ac5', '35e709a9-d2b3-4e24-a04a-fcfc444e1faf'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:14:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d83fd954-7f98-4e57-8b71-d358894cbf40 tempest-VolumesListAdminTestJSON-1494599046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d83fd954-7f98-4e57-8b71-d358894cbf40 tempest-VolumesListAdminTestJSON-1494599046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d83fd954-7f98-4e57-8b71-d358894cbf40 tempest-VolumesListAdminTestJSON-1494599046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:14:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d83fd954-7f98-4e57-8b71-d358894cbf40 tempest-VolumesListAdminTestJSON-1494599046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:14:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d83fd954-7f98-4e57-8b71-d358894cbf40 tempest-VolumesListAdminTestJSON-1494599046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d83fd954-7f98-4e57-8b71-d358894cbf40 tempest-VolumesListAdminTestJSON-1494599046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:50 devstack sudo[98182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:14:50 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:50 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6b5fe829-012f-45db-b1db-3b5f8c11c73f tempest-VolumesListAdminTestJSON-1121941468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3187e28a-1839-4a61-beb4-c289c0807716" returned: 0 in 0.507s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:50 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6b5fe829-012f-45db-b1db-3b5f8c11c73f tempest-VolumesListAdminTestJSON-1121941468 None] Lock "cinder-quobyte-3187e28a-1839-4a61-beb4-c289c0807716" released by "delete_volume" :: held 1.585s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:14:50 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-6b5fe829-012f-45db-b1db-3b5f8c11c73f tempest-VolumesListAdminTestJSON-1121941468 None] Created reservations ['27c338e7-257e-4525-b8cc-38041b911841', '23c14215-4acf-43c8-9526-c3e7cd4717a8', '1add47d1-2d59-4d08-b1e0-bb6f0bfcda44', '06a87a6a-6bdc-47b5-ba59-611e8386d303'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:14:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6b5fe829-012f-45db-b1db-3b5f8c11c73f tempest-VolumesListAdminTestJSON-1121941468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6b5fe829-012f-45db-b1db-3b5f8c11c73f tempest-VolumesListAdminTestJSON-1121941468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6b5fe829-012f-45db-b1db-3b5f8c11c73f tempest-VolumesListAdminTestJSON-1121941468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:14:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6b5fe829-012f-45db-b1db-3b5f8c11c73f tempest-VolumesListAdminTestJSON-1121941468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:14:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6b5fe829-012f-45db-b1db-3b5f8c11c73f tempest-VolumesListAdminTestJSON-1121941468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6b5fe829-012f-45db-b1db-3b5f8c11c73f tempest-VolumesListAdminTestJSON-1121941468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:50 devstack sudo[98184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:14:50 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:50 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d83fd954-7f98-4e57-8b71-d358894cbf40 tempest-VolumesListAdminTestJSON-1494599046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.688s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:50 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d83fd954-7f98-4e57-8b71-d358894cbf40 tempest-VolumesListAdminTestJSON-1494599046 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:14:50 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d83fd954-7f98-4e57-8b71-d358894cbf40 tempest-VolumesListAdminTestJSON-1494599046 None] Deleted volume successfully.
Sep 28 18:14:50 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d83fd954-7f98-4e57-8b71-d358894cbf40 tempest-VolumesListAdminTestJSON-1494599046 None] Lock "cinder-57fd6e0c-7251-48eb-9ecc-ccd07979482f-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:14:50 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6b5fe829-012f-45db-b1db-3b5f8c11c73f tempest-VolumesListAdminTestJSON-1121941468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.415s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:51 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-6b5fe829-012f-45db-b1db-3b5f8c11c73f tempest-VolumesListAdminTestJSON-1121941468 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:14:51 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-6b5fe829-012f-45db-b1db-3b5f8c11c73f tempest-VolumesListAdminTestJSON-1121941468 None] Deleted volume successfully.
Sep 28 18:14:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6b5fe829-012f-45db-b1db-3b5f8c11c73f tempest-VolumesListAdminTestJSON-1121941468 None] Lock "cinder-3187e28a-1839-4a61-beb4-c289c0807716-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:14:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-019991b1-92e1-4aca-b280-34125b0fc1b2 tempest-VolumesListAdminTestJSON-1121941468 None] Acquiring lock "cinder-5aee9065-6b1d-4990-865a-eb1790831601-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:14:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-019991b1-92e1-4aca-b280-34125b0fc1b2 tempest-VolumesListAdminTestJSON-1121941468 None] Lock "cinder-5aee9065-6b1d-4990-865a-eb1790831601-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:14:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-019991b1-92e1-4aca-b280-34125b0fc1b2 tempest-VolumesListAdminTestJSON-1121941468 None] Acquiring lock "cinder-quobyte-5aee9065-6b1d-4990-865a-eb1790831601" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:14:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-019991b1-92e1-4aca-b280-34125b0fc1b2 tempest-VolumesListAdminTestJSON-1121941468 None] Lock "cinder-quobyte-5aee9065-6b1d-4990-865a-eb1790831601" acquired by "delete_volume" :: waited 0.027s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:14:51 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6885c27c-dfb1-47f1-be8d-2136e757ff2c]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:14:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-019991b1-92e1-4aca-b280-34125b0fc1b2 tempest-VolumesListAdminTestJSON-1121941468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5aee9065-6b1d-4990-865a-eb1790831601 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:51 devstack sudo[98188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5aee9065-6b1d-4990-865a-eb1790831601
Sep 28 18:14:51 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:51 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-019991b1-92e1-4aca-b280-34125b0fc1b2 tempest-VolumesListAdminTestJSON-1121941468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5aee9065-6b1d-4990-865a-eb1790831601" returned: 0 in 0.617s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-019991b1-92e1-4aca-b280-34125b0fc1b2 tempest-VolumesListAdminTestJSON-1121941468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5aee9065-6b1d-4990-865a-eb1790831601 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:51 devstack sudo[98193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5aee9065-6b1d-4990-865a-eb1790831601
Sep 28 18:14:51 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:52 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-019991b1-92e1-4aca-b280-34125b0fc1b2 tempest-VolumesListAdminTestJSON-1121941468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5aee9065-6b1d-4990-865a-eb1790831601" returned: 0 in 0.440s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:52 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-019991b1-92e1-4aca-b280-34125b0fc1b2 tempest-VolumesListAdminTestJSON-1121941468 None] Lock "cinder-quobyte-5aee9065-6b1d-4990-865a-eb1790831601" released by "delete_volume" :: held 1.138s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:14:52 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-019991b1-92e1-4aca-b280-34125b0fc1b2 tempest-VolumesListAdminTestJSON-1121941468 None] Created reservations ['a04b7930-3872-4c74-a12c-8ed9f0f09284', '64d59eaa-ad5e-47a5-92c1-99b37df7260b', '7d3958b7-9160-4ed3-b149-b800f17d6f13', 'd9f74154-8cbf-4587-80d1-0e3a1eca8634'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:14:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-019991b1-92e1-4aca-b280-34125b0fc1b2 tempest-VolumesListAdminTestJSON-1121941468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-019991b1-92e1-4aca-b280-34125b0fc1b2 tempest-VolumesListAdminTestJSON-1121941468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:52 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-019991b1-92e1-4aca-b280-34125b0fc1b2 tempest-VolumesListAdminTestJSON-1121941468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:14:52 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-019991b1-92e1-4aca-b280-34125b0fc1b2 tempest-VolumesListAdminTestJSON-1121941468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:14:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-019991b1-92e1-4aca-b280-34125b0fc1b2 tempest-VolumesListAdminTestJSON-1121941468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-019991b1-92e1-4aca-b280-34125b0fc1b2 tempest-VolumesListAdminTestJSON-1121941468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:52 devstack sudo[98197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:14:52 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:53 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-019991b1-92e1-4aca-b280-34125b0fc1b2 tempest-VolumesListAdminTestJSON-1121941468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.517s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-019991b1-92e1-4aca-b280-34125b0fc1b2 tempest-VolumesListAdminTestJSON-1121941468 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:14:53 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-019991b1-92e1-4aca-b280-34125b0fc1b2 tempest-VolumesListAdminTestJSON-1121941468 None] Deleted volume successfully.
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-019991b1-92e1-4aca-b280-34125b0fc1b2 tempest-VolumesListAdminTestJSON-1121941468 None] Lock "cinder-5aee9065-6b1d-4990-865a-eb1790831601-delete_volume" released by "delete_volume" :: held 2.072s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Flow 'volume_create_manager' (0ef6a017-29d9-4c80-8c41-d652624fd532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ee8761-18a4-4bb6-9c77-62440fd587ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4cc96025-2db2-4adc-b1d5-71724e68b73d tempest-VolumesListAdminTestJSON-1121941468 None] Acquiring lock "cinder-fe37262b-5e61-4758-981d-c4cb54177629-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ee8761-18a4-4bb6-9c77-62440fd587ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-554397198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f40e4505-49b5-4747-9850-754c27fdb1b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f96a1b82666411f85fd9f0c935e733f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:54Z,use_quota=True,user_id='a3f7c081724d4b60af9557f6486372c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2d9781-490f-4598-a78b-a2e5cb1aac78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2d9781-490f-4598-a78b-a2e5cb1aac78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e563a7fb-4229-4f8c-874b-7941360d767f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e563a7fb-4229-4f8c-874b-7941360d767f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f40e4505-49b5-4747-9850-754c27fdb1b8', 'volume_name': 'volume-f40e4505-49b5-4747-9850-754c27fdb1b8', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c15cf96-e666-41f6-bd74-a99fc1e28144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c15cf96-e666-41f6-bd74-a99fc1e28144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0443b666-5a2c-4c16-8233-3321e8b01f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:53 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Volume f40e4505-49b5-4747-9850-754c27fdb1b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f40e4505-49b5-4747-9850-754c27fdb1b8', 'volume_size': 1}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-554397198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f40e4505-49b5-4747-9850-754c27fdb1b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f96a1b82666411f85fd9f0c935e733f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:54Z,use_quota=True,user_id='a3f7c081724d4b60af9557f6486372c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Creating volume f40e4505-49b5-4747-9850-754c27fdb1b8 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:14:53 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f40e4505-49b5-4747-9850-754c27fdb1b8 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4cc96025-2db2-4adc-b1d5-71724e68b73d tempest-VolumesListAdminTestJSON-1121941468 None] Lock "cinder-fe37262b-5e61-4758-981d-c4cb54177629-delete_volume" acquired by "delete_volume" :: waited 0.137s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:14:53 devstack sudo[98201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f40e4505-49b5-4747-9850-754c27fdb1b8 1073741824
Sep 28 18:14:53 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4cc96025-2db2-4adc-b1d5-71724e68b73d tempest-VolumesListAdminTestJSON-1121941468 None] Acquiring lock "cinder-quobyte-fe37262b-5e61-4758-981d-c4cb54177629" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:14:53 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4cc96025-2db2-4adc-b1d5-71724e68b73d tempest-VolumesListAdminTestJSON-1121941468 None] Lock "cinder-quobyte-fe37262b-5e61-4758-981d-c4cb54177629" acquired by "delete_volume" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:14:54 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23845dc-af1e-4a54-b33d-f75417763e73]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:14:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4cc96025-2db2-4adc-b1d5-71724e68b73d tempest-VolumesListAdminTestJSON-1121941468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fe37262b-5e61-4758-981d-c4cb54177629 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:54 devstack sudo[98203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fe37262b-5e61-4758-981d-c4cb54177629
Sep 28 18:14:54 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:54 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f40e4505-49b5-4747-9850-754c27fdb1b8 1073741824" returned: 0 in 0.927s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:54 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4cc96025-2db2-4adc-b1d5-71724e68b73d tempest-VolumesListAdminTestJSON-1121941468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fe37262b-5e61-4758-981d-c4cb54177629" returned: 0 in 0.818s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4cc96025-2db2-4adc-b1d5-71724e68b73d tempest-VolumesListAdminTestJSON-1121941468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fe37262b-5e61-4758-981d-c4cb54177629 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f40e4505-49b5-4747-9850-754c27fdb1b8 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:54 devstack sudo[98243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fe37262b-5e61-4758-981d-c4cb54177629
Sep 28 18:14:54 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:54 devstack sudo[98246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f40e4505-49b5-4747-9850-754c27fdb1b8
Sep 28 18:14:54 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:55 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4cc96025-2db2-4adc-b1d5-71724e68b73d tempest-VolumesListAdminTestJSON-1121941468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fe37262b-5e61-4758-981d-c4cb54177629" returned: 0 in 0.522s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:55 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4cc96025-2db2-4adc-b1d5-71724e68b73d tempest-VolumesListAdminTestJSON-1121941468 None] Lock "cinder-quobyte-fe37262b-5e61-4758-981d-c4cb54177629" released by "delete_volume" :: held 1.420s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:14:55 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-4cc96025-2db2-4adc-b1d5-71724e68b73d tempest-VolumesListAdminTestJSON-1121941468 None] Created reservations ['5c2f1521-d200-4661-8748-81b8b08916e8', 'a4fd04c9-99bd-4cf6-b4f6-48a66af814b5', 'a74fa1ef-4f29-4f76-a6a8-7f4217f5c453', 'e67a4a5c-d7e8-4b18-9f68-3dfd38b5be26'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:14:55 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f40e4505-49b5-4747-9850-754c27fdb1b8" returned: 0 in 0.657s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:14:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0443b666-5a2c-4c16-8233-3321e8b01f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f40e4505-49b5-4747-9850-754c27fdb1b8', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5515ab8-fe2c-4434-8773-2c1291e79155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:14:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-4cc96025-2db2-4adc-b1d5-71724e68b73d tempest-VolumesListAdminTestJSON-1121941468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-4cc96025-2db2-4adc-b1d5-71724e68b73d tempest-VolumesListAdminTestJSON-1121941468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-4cc96025-2db2-4adc-b1d5-71724e68b73d tempest-VolumesListAdminTestJSON-1121941468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:14:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-4cc96025-2db2-4adc-b1d5-71724e68b73d tempest-VolumesListAdminTestJSON-1121941468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:14:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-4cc96025-2db2-4adc-b1d5-71724e68b73d tempest-VolumesListAdminTestJSON-1121941468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4cc96025-2db2-4adc-b1d5-71724e68b73d tempest-VolumesListAdminTestJSON-1121941468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:55 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Volume volume-f40e4505-49b5-4747-9850-754c27fdb1b8 (f40e4505-49b5-4747-9850-754c27fdb1b8): created successfully
Sep 28 18:14:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5515ab8-fe2c-4434-8773-2c1291e79155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:14:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Flow 'volume_create_manager' (0ef6a017-29d9-4c80-8c41-d652624fd532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:14:55 devstack sudo[98277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:14:55 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:55 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-85988280-27e1-4937-b542-e507ecb90076 tempest-VolumesMetadataTest-413692649 None] Created volume successfully.
Sep 28 18:14:56 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4cc96025-2db2-4adc-b1d5-71724e68b73d tempest-VolumesListAdminTestJSON-1121941468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.532s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:56 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-4cc96025-2db2-4adc-b1d5-71724e68b73d tempest-VolumesListAdminTestJSON-1121941468 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:14:56 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-4cc96025-2db2-4adc-b1d5-71724e68b73d tempest-VolumesListAdminTestJSON-1121941468 None] Deleted volume successfully.
Sep 28 18:14:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4cc96025-2db2-4adc-b1d5-71724e68b73d tempest-VolumesListAdminTestJSON-1121941468 None] Lock "cinder-fe37262b-5e61-4758-981d-c4cb54177629-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:14:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-644c5b72-8ae0-42bf-8278-4d5c6ef68385 tempest-VolumesMetadataTest-413692649 None] Acquiring lock "cinder-f40e4505-49b5-4747-9850-754c27fdb1b8-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:14:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-644c5b72-8ae0-42bf-8278-4d5c6ef68385 tempest-VolumesMetadataTest-413692649 None] Lock "cinder-f40e4505-49b5-4747-9850-754c27fdb1b8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:14:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-644c5b72-8ae0-42bf-8278-4d5c6ef68385 tempest-VolumesMetadataTest-413692649 None] Acquiring lock "cinder-quobyte-f40e4505-49b5-4747-9850-754c27fdb1b8" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:14:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-644c5b72-8ae0-42bf-8278-4d5c6ef68385 tempest-VolumesMetadataTest-413692649 None] Lock "cinder-quobyte-f40e4505-49b5-4747-9850-754c27fdb1b8" acquired by "delete_volume" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:14:57 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00ca58e-95b1-470b-9a81-12a2f4a5e7bb]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:14:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-644c5b72-8ae0-42bf-8278-4d5c6ef68385 tempest-VolumesMetadataTest-413692649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f40e4505-49b5-4747-9850-754c27fdb1b8 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:58 devstack sudo[98303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f40e4505-49b5-4747-9850-754c27fdb1b8
Sep 28 18:14:58 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:58 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-644c5b72-8ae0-42bf-8278-4d5c6ef68385 tempest-VolumesMetadataTest-413692649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f40e4505-49b5-4747-9850-754c27fdb1b8" returned: 0 in 1.067s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-644c5b72-8ae0-42bf-8278-4d5c6ef68385 tempest-VolumesMetadataTest-413692649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f40e4505-49b5-4747-9850-754c27fdb1b8 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:58 devstack sudo[98311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f40e4505-49b5-4747-9850-754c27fdb1b8
Sep 28 18:14:58 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:14:59 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root
Sep 28 18:14:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-644c5b72-8ae0-42bf-8278-4d5c6ef68385 tempest-VolumesMetadataTest-413692649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f40e4505-49b5-4747-9850-754c27fdb1b8" returned: 0 in 0.431s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:14:59 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-644c5b72-8ae0-42bf-8278-4d5c6ef68385 tempest-VolumesMetadataTest-413692649 None] Lock "cinder-quobyte-f40e4505-49b5-4747-9850-754c27fdb1b8" released by "delete_volume" :: held 1.600s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:14:59 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-644c5b72-8ae0-42bf-8278-4d5c6ef68385 tempest-VolumesMetadataTest-413692649 None] Created reservations ['63ef381f-087f-4841-8941-f586fe85a259', 'c1460653-57a7-42d8-93fb-9dbfeb47084d', '404a47f9-5481-46b9-bb19-4aad21e5d228', '9aa84665-7373-4e96-9348-3301cf33f273'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:14:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-644c5b72-8ae0-42bf-8278-4d5c6ef68385 tempest-VolumesMetadataTest-413692649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:14:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-644c5b72-8ae0-42bf-8278-4d5c6ef68385 tempest-VolumesMetadataTest-413692649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:14:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-644c5b72-8ae0-42bf-8278-4d5c6ef68385 tempest-VolumesMetadataTest-413692649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:14:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-644c5b72-8ae0-42bf-8278-4d5c6ef68385 tempest-VolumesMetadataTest-413692649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:14:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-644c5b72-8ae0-42bf-8278-4d5c6ef68385 tempest-VolumesMetadataTest-413692649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:14:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-644c5b72-8ae0-42bf-8278-4d5c6ef68385 tempest-VolumesMetadataTest-413692649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:14:59 devstack sudo[98314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:14:59 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:00 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-644c5b72-8ae0-42bf-8278-4d5c6ef68385 tempest-VolumesMetadataTest-413692649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.706s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:00 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-644c5b72-8ae0-42bf-8278-4d5c6ef68385 tempest-VolumesMetadataTest-413692649 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:15:00 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-644c5b72-8ae0-42bf-8278-4d5c6ef68385 tempest-VolumesMetadataTest-413692649 None] Deleted volume successfully.
Sep 28 18:15:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-644c5b72-8ae0-42bf-8278-4d5c6ef68385 tempest-VolumesMetadataTest-413692649 None] Lock "cinder-f40e4505-49b5-4747-9850-754c27fdb1b8-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:15:09 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=53,cinder:UPDATE=64,cinder:INSERT=16,cinder:DELETE=8 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:15:10 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=54,cinder:UPDATE=88,cinder:INSERT=17,cinder:DELETE=4 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:15:12 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:15:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Flow 'volume_create_manager' (76ee0837-90ae-495a-acdc-a2fb11e148a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:15:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf925d3-c08c-4286-baf1-88525bc06312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf925d3-c08c-4286-baf1-88525bc06312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1192781953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826fbb65-4df8-44d7-b4bc-e40b8286f667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d8a609c3964487ab7980cda2b4f8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:12Z,use_quota=True,user_id='0d81ab70a1ae42aa8a6e1e37c12e940d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d20143c-fd5d-433a-8ece-53c2d3eab260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d20143c-fd5d-433a-8ece-53c2d3eab260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6b3af6-c768-4d85-af78-0a3c42dbc0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:12 devstack cinder-volume[87046]: DEBUG cinder.image.glance [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Creating Keystone auth plugin from conf {{(pid=87046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 28 18:15:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6b3af6-c768-4d85-af78-0a3c42dbc0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '826fbb65-4df8-44d7-b4bc-e40b8286f667', 'volume_name': 'volume-826fbb65-4df8-44d7-b4bc-e40b8286f667', 'volume_size': 1, 'image_id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de2452cfca174dfbbc7b50b163b23faa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'created_at': datetime.datetime(2026, 9, 28, 15, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 58, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aa49bda90>}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f94a028-89d6-46b9-8d72-05a824140598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f94a028-89d6-46b9-8d72-05a824140598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa1bf41-471b-4aeb-a112-9fd48435a4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:13 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Volume 826fbb65-4df8-44d7-b4bc-e40b8286f667: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-826fbb65-4df8-44d7-b4bc-e40b8286f667', 'volume_size': 1, 'image_id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de2452cfca174dfbbc7b50b163b23faa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'created_at': datetime.datetime(2026, 9, 28, 15, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 58, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aa49bda90>}
Sep 28 18:15:13 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Trying to clone 826fbb65-4df8-44d7-b4bc-e40b8286f667 from image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}]). {{(pid=87046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 28 18:15:13 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_rcbpzu41devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 28 18:15:13 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Image download 20.69 MB at 20.69 MB/s
Sep 28 18:15:13 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f19cdd6-b378-4063-9915-dfcca03fe138]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:15:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_rcbpzu41devstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:13 devstack sudo[98359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_rcbpzu41devstack@QuobyteHD
Sep 28 18:15:13 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:14 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_rcbpzu41devstack@QuobyteHD" returned: 0 in 0.425s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:14 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Temporary image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 is fetched for user 0d81ab70a1ae42aa8a6e1e37c12e940d. {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 28 18:15:14 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a002b9b-fe24-4179-ab65-c65a1e60ab34]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:15:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_rcbpzu41devstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:14 devstack sudo[98364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_rcbpzu41devstack@QuobyteHD
Sep 28 18:15:14 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:14 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_rcbpzu41devstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:15:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:15:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1192781953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826fbb65-4df8-44d7-b4bc-e40b8286f667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d8a609c3964487ab7980cda2b4f8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:12Z,use_quota=True,user_id='0d81ab70a1ae42aa8a6e1e37c12e940d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:15:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Creating volume 826fbb65-4df8-44d7-b4bc-e40b8286f667 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:15:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:15:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:15:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:15:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:15:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:15:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:15:14 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:15:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-826fbb65-4df8-44d7-b4bc-e40b8286f667 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:14 devstack sudo[98369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-826fbb65-4df8-44d7-b4bc-e40b8286f667 1073741824
Sep 28 18:15:14 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:15 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-826fbb65-4df8-44d7-b4bc-e40b8286f667 1073741824" returned: 0 in 0.545s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-826fbb65-4df8-44d7-b4bc-e40b8286f667 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:15 devstack sudo[98375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-826fbb65-4df8-44d7-b4bc-e40b8286f667
Sep 28 18:15:15 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:15 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-826fbb65-4df8-44d7-b4bc-e40b8286f667" returned: 0 in 0.378s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:15:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:15:15 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Attempting download of c5b6ff95-792c-4fb0-b8e7-dea90bc76834 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}])) to volume 826fbb65-4df8-44d7-b4bc-e40b8286f667. {{(pid=87046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 28 18:15:15 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89fb172-2cb9-4a82-892b-e41d16170bbf]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:15:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_dl9gwwhz {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:15 devstack sudo[98378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_dl9gwwhz
Sep 28 18:15:15 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:16 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_dl9gwwhz" returned: 0 in 0.436s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_dl9gwwhz {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:16 devstack sudo[98382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_dl9gwwhz
Sep 28 18:15:16 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:16 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_dl9gwwhz" returned: 1 in 0.457s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_dl9gwwhz' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:15:16 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64915a7-1116-496c-912a-2eb8a6d6da25]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:15:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_rcbpzu41devstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:16 devstack sudo[98386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_rcbpzu41devstack@QuobyteHD
Sep 28 18:15:16 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:17 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_rcbpzu41devstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:17 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] c5b6ff95-792c-4fb0-b8e7-dea90bc76834 was qcow2, converting to qcow2 {{(pid=87046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 28 18:15:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_rcbpzu41devstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-826fbb65-4df8-44d7-b4bc-e40b8286f667 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:17 devstack sudo[98391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_rcbpzu41devstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-826fbb65-4df8-44d7-b4bc-e40b8286f667
Sep 28 18:15:17 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:19 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_rcbpzu41devstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-826fbb65-4df8-44d7-b4bc-e40b8286f667" returned: 0 in 2.775s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:19 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_rcbpzu41devstack@QuobyteHD, size 112.00 MB, duration 2.78 sec, destination /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-826fbb65-4df8-44d7-b4bc-e40b8286f667 {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:15:19 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Converted 112.00 MB image at 40.34 MB/s
Sep 28 18:15:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-826fbb65-4df8-44d7-b4bc-e40b8286f667 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:19 devstack sudo[98400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-826fbb65-4df8-44d7-b4bc-e40b8286f667 1G
Sep 28 18:15:19 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:20 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-826fbb65-4df8-44d7-b4bc-e40b8286f667 1G" returned: 0 in 0.407s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:20 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Downloaded image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}])) to volume 826fbb65-4df8-44d7-b4bc-e40b8286f667 successfully. {{(pid=87046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 28 18:15:20 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Temporary image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 for user 0d81ab70a1ae42aa8a6e1e37c12e940d is deleted. {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 28 18:15:20 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Marking volume 826fbb65-4df8-44d7-b4bc-e40b8286f667 as bootable. {{(pid=87046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 28 18:15:20 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Copying metadata from image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 to 826fbb65-4df8-44d7-b4bc-e40b8286f667. {{(pid=87046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 28 18:15:20 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Creating volume glance metadata for volume 826fbb65-4df8-44d7-b4bc-e40b8286f667 backed by image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 28 18:15:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa1bf41-471b-4aeb-a112-9fd48435a4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-826fbb65-4df8-44d7-b4bc-e40b8286f667', 'volume_size': 1, 'image_id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de2452cfca174dfbbc7b50b163b23faa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'created_at': datetime.datetime(2026, 9, 28, 15, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 58, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aa49bda90>}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a01995a-8df7-442f-80bd-20f729fb39a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:20 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Volume volume-826fbb65-4df8-44d7-b4bc-e40b8286f667 (826fbb65-4df8-44d7-b4bc-e40b8286f667): created successfully
Sep 28 18:15:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a01995a-8df7-442f-80bd-20f729fb39a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Flow 'volume_create_manager' (76ee0837-90ae-495a-acdc-a2fb11e148a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:15:20 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-1227b50f-d0c0-4e8b-bdd7-8fb031071ee8 tempest-VolumesImageMetadata-1347786998 None] Created volume successfully.
Sep 28 18:15:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-aed0d422-fcd8-42b5-9e5b-d66a87e5167b tempest-VolumesImageMetadata-1347786998 None] Acquiring lock "cinder-826fbb65-4df8-44d7-b4bc-e40b8286f667-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:15:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-aed0d422-fcd8-42b5-9e5b-d66a87e5167b tempest-VolumesImageMetadata-1347786998 None] Lock "cinder-826fbb65-4df8-44d7-b4bc-e40b8286f667-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:15:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-aed0d422-fcd8-42b5-9e5b-d66a87e5167b tempest-VolumesImageMetadata-1347786998 None] Acquiring lock "cinder-quobyte-826fbb65-4df8-44d7-b4bc-e40b8286f667" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:15:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-aed0d422-fcd8-42b5-9e5b-d66a87e5167b tempest-VolumesImageMetadata-1347786998 None] Lock "cinder-quobyte-826fbb65-4df8-44d7-b4bc-e40b8286f667" acquired by "delete_volume" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:15:22 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[282314a3-ddc9-4f9d-b128-881bccd25b43]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:15:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aed0d422-fcd8-42b5-9e5b-d66a87e5167b tempest-VolumesImageMetadata-1347786998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-826fbb65-4df8-44d7-b4bc-e40b8286f667 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:22 devstack sudo[98409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-826fbb65-4df8-44d7-b4bc-e40b8286f667
Sep 28 18:15:22 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:22 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aed0d422-fcd8-42b5-9e5b-d66a87e5167b tempest-VolumesImageMetadata-1347786998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-826fbb65-4df8-44d7-b4bc-e40b8286f667" returned: 0 in 0.524s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aed0d422-fcd8-42b5-9e5b-d66a87e5167b tempest-VolumesImageMetadata-1347786998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-826fbb65-4df8-44d7-b4bc-e40b8286f667 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:22 devstack sudo[98415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-826fbb65-4df8-44d7-b4bc-e40b8286f667
Sep 28 18:15:22 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:22 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aed0d422-fcd8-42b5-9e5b-d66a87e5167b tempest-VolumesImageMetadata-1347786998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-826fbb65-4df8-44d7-b4bc-e40b8286f667" returned: 0 in 0.354s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-aed0d422-fcd8-42b5-9e5b-d66a87e5167b tempest-VolumesImageMetadata-1347786998 None] Lock "cinder-quobyte-826fbb65-4df8-44d7-b4bc-e40b8286f667" released by "delete_volume" :: held 0.952s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:15:23 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-aed0d422-fcd8-42b5-9e5b-d66a87e5167b tempest-VolumesImageMetadata-1347786998 None] Created reservations ['85e20cac-6228-4ac7-b821-a343d56df03b', 'aa19f1fe-968b-42db-b2c5-e3251d84f1bd', '10dd2f15-66c0-4cf5-a7f5-0bc49d32547d', '531c2c3a-1d52-4200-b569-00ca54c7d954'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:15:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-aed0d422-fcd8-42b5-9e5b-d66a87e5167b tempest-VolumesImageMetadata-1347786998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:15:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-aed0d422-fcd8-42b5-9e5b-d66a87e5167b tempest-VolumesImageMetadata-1347786998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:15:23 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-aed0d422-fcd8-42b5-9e5b-d66a87e5167b tempest-VolumesImageMetadata-1347786998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:15:23 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-aed0d422-fcd8-42b5-9e5b-d66a87e5167b tempest-VolumesImageMetadata-1347786998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:15:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-aed0d422-fcd8-42b5-9e5b-d66a87e5167b tempest-VolumesImageMetadata-1347786998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:15:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aed0d422-fcd8-42b5-9e5b-d66a87e5167b tempest-VolumesImageMetadata-1347786998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:23 devstack sudo[98419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:15:23 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:23 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aed0d422-fcd8-42b5-9e5b-d66a87e5167b tempest-VolumesImageMetadata-1347786998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.563s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:23 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-aed0d422-fcd8-42b5-9e5b-d66a87e5167b tempest-VolumesImageMetadata-1347786998 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:15:23 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-aed0d422-fcd8-42b5-9e5b-d66a87e5167b tempest-VolumesImageMetadata-1347786998 None] Deleted volume successfully.
Sep 28 18:15:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-aed0d422-fcd8-42b5-9e5b-d66a87e5167b tempest-VolumesImageMetadata-1347786998 None] Lock "cinder-826fbb65-4df8-44d7-b4bc-e40b8286f667-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:15:25 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:15:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Flow 'volume_create_manager' (5bf76b49-d181-4abe-a4f1-6382bf3e2c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:15:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (049fef02-42b8-4f71-940b-bd959ff8a5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (049fef02-42b8-4f71-940b-bd959ff8a5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1255006471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5bea976-9570-47b0-9f04-e224002634f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25af8ad8931f485d978e50822454de79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:25Z,use_quota=True,user_id='1e9305f85783458b9c336d0e54e4e249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63430540-ce16-4bd4-8886-ea1e300331ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63430540-ce16-4bd4-8886-ea1e300331ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f900e9-46e7-40c1-86a8-9b3756541dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f900e9-46e7-40c1-86a8-9b3756541dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5bea976-9570-47b0-9f04-e224002634f7', 'volume_name': 'volume-d5bea976-9570-47b0-9f04-e224002634f7', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ee185e-54f9-48db-8cbd-b99ee5bc2ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ee185e-54f9-48db-8cbd-b99ee5bc2ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:25 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d189e16e-c0bb-4117-8035-9d1ecd53fd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:25 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Volume d5bea976-9570-47b0-9f04-e224002634f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5bea976-9570-47b0-9f04-e224002634f7', 'volume_size': 1}
Sep 28 18:15:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:15:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:15:25 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1255006471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5bea976-9570-47b0-9f04-e224002634f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25af8ad8931f485d978e50822454de79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:25Z,use_quota=True,user_id='1e9305f85783458b9c336d0e54e4e249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:15:25 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Creating volume d5bea976-9570-47b0-9f04-e224002634f7 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:15:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:15:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:15:25 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:15:25 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:15:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:15:25 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:15:25 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:15:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:25 devstack sudo[98458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7 1073741824
Sep 28 18:15:25 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:26 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7 1073741824" returned: 0 in 0.852s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:26 devstack sudo[98466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7
Sep 28 18:15:26 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Flow 'volume_create_manager' (bd26b884-1963-432c-b6f6-5db5d7c63984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443dc086-c6d8-42f1-890c-b46391f7d42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443dc086-c6d8-42f1-890c-b46391f7d42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-598985986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5baf24-952e-440a-afd5-4c8d13bdf4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8ac573af3742b5a7febc9c35a6057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:27Z,use_quota=True,user_id='46dfea941a274f1a85f70bef0a6c2d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (407bdb27-b462-4fe6-ab2f-65638d2b4725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (407bdb27-b462-4fe6-ab2f-65638d2b4725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc3e892-c5e2-40de-a297-8407c2d68c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc3e892-c5e2-40de-a297-8407c2d68c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af5baf24-952e-440a-afd5-4c8d13bdf4d9', 'volume_name': 'volume-af5baf24-952e-440a-afd5-4c8d13bdf4d9', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (affe7f6f-cd1a-41d4-a0c6-be2ae7509fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (affe7f6f-cd1a-41d4-a0c6-be2ae7509fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:26 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be499b28-cabe-4556-a14a-0aa86ce8025a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:26 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Volume af5baf24-952e-440a-afd5-4c8d13bdf4d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af5baf24-952e-440a-afd5-4c8d13bdf4d9', 'volume_size': 1}
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7" returned: 0 in 0.436s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-598985986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5baf24-952e-440a-afd5-4c8d13bdf4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8ac573af3742b5a7febc9c35a6057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:27Z,use_quota=True,user_id='46dfea941a274f1a85f70bef0a6c2d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Creating volume af5baf24-952e-440a-afd5-4c8d13bdf4d9 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:15:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:15:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:15:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:15:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:15:27 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:15:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af5baf24-952e-440a-afd5-4c8d13bdf4d9 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d189e16e-c0bb-4117-8035-9d1ecd53fd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5bea976-9570-47b0-9f04-e224002634f7', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd319940-42e6-4bc2-a477-63efd0c15f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:27 devstack sudo[98469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af5baf24-952e-440a-afd5-4c8d13bdf4d9 1073741824
Sep 28 18:15:27 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Volume volume-d5bea976-9570-47b0-9f04-e224002634f7 (d5bea976-9570-47b0-9f04-e224002634f7): created successfully
Sep 28 18:15:27 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd319940-42e6-4bc2-a477-63efd0c15f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Flow 'volume_create_manager' (5bf76b49-d181-4abe-a4f1-6382bf3e2c65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:15:27 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-1bee148b-dc90-441f-976b-d0438070836a tempest-VolumesActionsTest-1998868577 None] Created volume successfully.
Sep 28 18:15:27 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af5baf24-952e-440a-afd5-4c8d13bdf4d9 1073741824" returned: 0 in 0.804s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af5baf24-952e-440a-afd5-4c8d13bdf4d9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:27 devstack sudo[98475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af5baf24-952e-440a-afd5-4c8d13bdf4d9
Sep 28 18:15:27 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:28 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af5baf24-952e-440a-afd5-4c8d13bdf4d9" returned: 0 in 0.400s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:28 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:15:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:15:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be499b28-cabe-4556-a14a-0aa86ce8025a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af5baf24-952e-440a-afd5-4c8d13bdf4d9', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302fd216-3931-4a3c-b861-46ecb5ae8186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:28 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Volume volume-af5baf24-952e-440a-afd5-4c8d13bdf4d9 (af5baf24-952e-440a-afd5-4c8d13bdf4d9): created successfully
Sep 28 18:15:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302fd216-3931-4a3c-b861-46ecb5ae8186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Flow 'volume_create_manager' (bd26b884-1963-432c-b6f6-5db5d7c63984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:15:28 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-42f8607c-eaa9-4340-9478-d671e074cdf9 tempest-AttachVolumeNegativeTest-1944680203 None] Created volume successfully.
Sep 28 18:15:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-b75bed23-9713-427b-9eb4-2d87a34f48b8 req-b41efdce-0042-4376-96d6-8111c037c0e4 tempest-AttachVolumeNegativeTest-1944680203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:15:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-b75bed23-9713-427b-9eb4-2d87a34f48b8 req-b41efdce-0042-4376-96d6-8111c037c0e4 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:15:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-b75bed23-9713-427b-9eb4-2d87a34f48b8 req-b41efdce-0042-4376-96d6-8111c037c0e4 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:15:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-b75bed23-9713-427b-9eb4-2d87a34f48b8 req-b41efdce-0042-4376-96d6-8111c037c0e4 tempest-AttachVolumeNegativeTest-1944680203 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-af5baf24-952e-440a-afd5-4c8d13bdf4d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3d403c4-59f2-4219-8c10-7dcbfae71155', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:15:30 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-b75bed23-9713-427b-9eb4-2d87a34f48b8 req-b41efdce-0042-4376-96d6-8111c037c0e4 tempest-AttachVolumeNegativeTest-1944680203 None] attachment_update completed successfully.
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Flow 'volume_create_manager' (2ab69012-e1a5-461e-ba1e-67f149cc93b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8682e5e-60b5-4733-a948-a649aaed666a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8682e5e-60b5-4733-a948-a649aaed666a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1000882039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d665fd20-7c70-45a6-9348-326a2b08e81d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee286d8ad834f2587350f5518cba74e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:32Z,use_quota=True,user_id='8f6a49111ce14bb8866b0dab866449df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab82b501-8120-4106-b1dd-cb00c234da14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab82b501-8120-4106-b1dd-cb00c234da14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6945bd4f-6934-4085-bc83-3d831e63416f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6945bd4f-6934-4085-bc83-3d831e63416f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd665fd20-7c70-45a6-9348-326a2b08e81d', 'volume_name': 'volume-d665fd20-7c70-45a6-9348-326a2b08e81d', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7253394a-7364-4ef6-ab0c-c080bf5a652f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7253394a-7364-4ef6-ab0c-c080bf5a652f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa58963-51b7-4f5a-8afc-2479e7506ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:32 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Volume d665fd20-7c70-45a6-9348-326a2b08e81d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d665fd20-7c70-45a6-9348-326a2b08e81d', 'volume_size': 1}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1000882039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d665fd20-7c70-45a6-9348-326a2b08e81d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee286d8ad834f2587350f5518cba74e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:32Z,use_quota=True,user_id='8f6a49111ce14bb8866b0dab866449df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Creating volume d665fd20-7c70-45a6-9348-326a2b08e81d {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:15:32 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:32 devstack sudo[98913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d 1073741824
Sep 28 18:15:32 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Flow 'volume_create_manager' (11325932-3f79-48f3-8ec0-d3bf914303ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a1846d-7b3b-49dc-8555-3e364e696a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a1846d-7b3b-49dc-8555-3e364e696a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1805174812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83842ca-59f6-412d-99dc-c9543b5d00c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f136e2110304a278660aed58dbfdbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:32Z,use_quota=True,user_id='852e8cd8184d46e79143cc2f82564760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18be259e-9a9f-4b70-b93d-1338111176f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18be259e-9a9f-4b70-b93d-1338111176f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebd8113-c461-486b-8cab-3f613f992f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebd8113-c461-486b-8cab-3f613f992f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b83842ca-59f6-412d-99dc-c9543b5d00c4', 'volume_name': 'volume-b83842ca-59f6-412d-99dc-c9543b5d00c4', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f0035d-7390-4198-847a-85e1a96b09bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f0035d-7390-4198-847a-85e1a96b09bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee96fe6a-7732-4f63-8458-46ffab70512f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:32 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Volume b83842ca-59f6-412d-99dc-c9543b5d00c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b83842ca-59f6-412d-99dc-c9543b5d00c4', 'volume_size': 1}
Sep 28 18:15:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:15:33 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d 1073741824" returned: 0 in 0.717s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:33 devstack sudo[98923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d
Sep 28 18:15:33 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:33 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d" returned: 0 in 0.353s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:15:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:15:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.874s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:15:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1805174812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83842ca-59f6-412d-99dc-c9543b5d00c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f136e2110304a278660aed58dbfdbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:32Z,use_quota=True,user_id='852e8cd8184d46e79143cc2f82564760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:15:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Creating volume b83842ca-59f6-412d-99dc-c9543b5d00c4 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:15:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:15:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:15:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:15:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:15:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:15:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:15:33 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:15:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa58963-51b7-4f5a-8afc-2479e7506ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d665fd20-7c70-45a6-9348-326a2b08e81d', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:33 devstack sudo[98935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4 1073741824
Sep 28 18:15:33 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1336ea6-b03e-47ac-a91f-020d0b22f6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:33 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Volume volume-d665fd20-7c70-45a6-9348-326a2b08e81d (d665fd20-7c70-45a6-9348-326a2b08e81d): created successfully
Sep 28 18:15:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1336ea6-b03e-47ac-a91f-020d0b22f6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Flow 'volume_create_manager' (2ab69012-e1a5-461e-ba1e-67f149cc93b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:15:33 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-bf889c3c-7342-4b2e-a6ed-6b904abf318d tempest-TestImageHashVerification-2109569672 None] Created volume successfully.
Sep 28 18:15:34 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4 1073741824" returned: 0 in 0.926s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:34 devstack sudo[98951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4
Sep 28 18:15:34 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:34 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-59e95529-073d-44f1-a49d-44e6dbeb04b5 req-bece0fbf-8bd1-4868-a131-62aef5319f90 tempest-AttachVolumeNegativeTest-1944680203 None] Terminate volume connection completed successfully.
Sep 28 18:15:34 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-59e95529-073d-44f1-a49d-44e6dbeb04b5 req-bece0fbf-8bd1-4868-a131-62aef5319f90 tempest-AttachVolumeNegativeTest-1944680203 None] Deleting attachment a3d403c4-59f2-4219-8c10-7dcbfae71155. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:15:35 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4" returned: 0 in 0.486s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:15:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:15:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee96fe6a-7732-4f63-8458-46ffab70512f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b83842ca-59f6-412d-99dc-c9543b5d00c4', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f4614c-9b97-4461-82de-1d37b8d393bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:15:35 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Volume volume-b83842ca-59f6-412d-99dc-c9543b5d00c4 (b83842ca-59f6-412d-99dc-c9543b5d00c4): created successfully
Sep 28 18:15:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f4614c-9b97-4461-82de-1d37b8d393bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:15:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Flow 'volume_create_manager' (11325932-3f79-48f3-8ec0-d3bf914303ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:15:35 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-01d14c1b-aff0-4dbd-ad56-39b2b9ed98c7 tempest-VolumesDeleteCascade-1102490638 None] Created volume successfully.
Sep 28 18:15:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d42a291e-e41d-44bc-9d12-3875dcdadc84 tempest-TestImageHashVerification-2109569672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:15:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d42a291e-e41d-44bc-9d12-3875dcdadc84 tempest-TestImageHashVerification-2109569672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:15:35 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90732fa-479e-499f-b166-8bec58f6d868]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:15:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d42a291e-e41d-44bc-9d12-3875dcdadc84 tempest-TestImageHashVerification-2109569672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-eff39868-d8fe-4676-a49a-c7e4160eaa1c tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:15:36 devstack sudo[98984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d
Sep 28 18:15:36 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:36 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d42a291e-e41d-44bc-9d12-3875dcdadc84 tempest-TestImageHashVerification-2109569672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d" returned: 0 in 0.692s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:36 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3886d78d-8ddf-4088-ae9c-94849526154a]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:15:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d42a291e-e41d-44bc-9d12-3875dcdadc84 tempest-TestImageHashVerification-2109569672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:36 devstack sudo[99008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d
Sep 28 18:15:36 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:37 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d42a291e-e41d-44bc-9d12-3875dcdadc84 tempest-TestImageHashVerification-2109569672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d" returned: 0 in 0.876s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d42a291e-e41d-44bc-9d12-3875dcdadc84 tempest-TestImageHashVerification-2109569672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d /opt/stack/data/cinder/conversion/d665fd20-7c70-45a6-9348-326a2b08e81d.temp_image.5b23b260-0e38-4885-a377-2653c3410f59hbz8wqtt.img {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:37 devstack sudo[99044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d /opt/stack/data/cinder/conversion/d665fd20-7c70-45a6-9348-326a2b08e81d.temp_image.5b23b260-0e38-4885-a377-2653c3410f59hbz8wqtt.img
Sep 28 18:15:37 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:15:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:15:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:15:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:15:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:15:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:15:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:39 devstack sudo[99095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:15:39 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:40 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 1.044s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:40 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:15:40 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:15:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:15:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:15:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b9ed28c1-dde8-4a49-b514-0422f07f3dd8 tempest-VolumesActionsTest-1998868577 None] Acquiring lock "cinder-d5bea976-9570-47b0-9f04-e224002634f7" by "attach_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:15:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b9ed28c1-dde8-4a49-b514-0422f07f3dd8 tempest-VolumesActionsTest-1998868577 None] Lock "cinder-d5bea976-9570-47b0-9f04-e224002634f7" acquired by "attach_volume" :: waited 0.070s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:15:45 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-b9ed28c1-dde8-4a49-b514-0422f07f3dd8 tempest-VolumesActionsTest-1998868577 None] Attaching volume d5bea976-9570-47b0-9f04-e224002634f7 to instance d4917fe5-3f7c-44a1-a835-2f34601592cd at mountpoint /dev/vdb on host None.
Sep 28 18:15:45 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-b9ed28c1-dde8-4a49-b514-0422f07f3dd8 tempest-VolumesActionsTest-1998868577 None] Attach volume completed successfully.
Sep 28 18:15:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b9ed28c1-dde8-4a49-b514-0422f07f3dd8 tempest-VolumesActionsTest-1998868577 None] Lock "cinder-d5bea976-9570-47b0-9f04-e224002634f7" released by "attach_volume" :: held 0.262s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:15:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-670ebafa-a835-4097-9088-1d1bb02d6abe tempest-VolumesActionsTest-1998868577 None] Acquiring lock "cinder-d5bea976-9570-47b0-9f04-e224002634f7-detach_volume" by "detach_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:15:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-670ebafa-a835-4097-9088-1d1bb02d6abe tempest-VolumesActionsTest-1998868577 None] Lock "cinder-d5bea976-9570-47b0-9f04-e224002634f7-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:15:46 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-670ebafa-a835-4097-9088-1d1bb02d6abe tempest-VolumesActionsTest-1998868577 None] Detaching volume d5bea976-9570-47b0-9f04-e224002634f7 from instance d4917fe5-3f7c-44a1-a835-2f34601592cd.
Sep 28 18:15:46 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-670ebafa-a835-4097-9088-1d1bb02d6abe tempest-VolumesActionsTest-1998868577 None] Detach volume completed successfully.
Sep 28 18:15:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-670ebafa-a835-4097-9088-1d1bb02d6abe tempest-VolumesActionsTest-1998868577 None] Lock "cinder-d5bea976-9570-47b0-9f04-e224002634f7-detach_volume" released by "detach_volume" :: held 0.146s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:15:48 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d42a291e-e41d-44bc-9d12-3875dcdadc84 tempest-TestImageHashVerification-2109569672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d /opt/stack/data/cinder/conversion/d665fd20-7c70-45a6-9348-326a2b08e81d.temp_image.5b23b260-0e38-4885-a377-2653c3410f59hbz8wqtt.img" returned: 0 in 10.771s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:48 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c715e81-113b-49d6-a03c-e8f713036aba]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:15:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d42a291e-e41d-44bc-9d12-3875dcdadc84 tempest-TestImageHashVerification-2109569672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:15:48 devstack sudo[99137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d
Sep 28 18:15:48 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:15:48 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root
Sep 28 18:15:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d42a291e-e41d-44bc-9d12-3875dcdadc84 tempest-TestImageHashVerification-2109569672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d" returned: 0 in 0.621s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:15:48 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-d42a291e-e41d-44bc-9d12-3875dcdadc84 tempest-TestImageHashVerification-2109569672 None] Image conversion details: src /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d, size 1024.00 MB, duration 10.78 sec, destination /opt/stack/data/cinder/conversion/d665fd20-7c70-45a6-9348-326a2b08e81d.temp_image.5b23b260-0e38-4885-a377-2653c3410f59hbz8wqtt.img {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:15:48 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-d42a291e-e41d-44bc-9d12-3875dcdadc84 tempest-TestImageHashVerification-2109569672 None] Converted 1024.00 MB image at 95.01 MB/s
Sep 28 18:15:48 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-d42a291e-e41d-44bc-9d12-3875dcdadc84 tempest-TestImageHashVerification-2109569672 None] 5b23b260-0e38-4885-a377-2653c3410f59 was raw, no need to convert to raw {{(pid=87046) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 28 18:15:58 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=38,cinder:UPDATE=31,cinder:INSERT=10,cinder:DELETE=4 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:15:58 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:UPDATE=28,cinder:SELECT=39,cinder:INSERT=14,cinder:DELETE=2 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:16:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-aaa2f1a9-b19b-4a70-8f7d-4eba6dc2f281 tempest-VolumesActionsTest-1998868577 None] Acquiring lock "cinder-d5bea976-9570-47b0-9f04-e224002634f7" by "attach_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:16:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-aaa2f1a9-b19b-4a70-8f7d-4eba6dc2f281 tempest-VolumesActionsTest-1998868577 None] Lock "cinder-d5bea976-9570-47b0-9f04-e224002634f7" acquired by "attach_volume" :: waited 0.034s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:16:08 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-aaa2f1a9-b19b-4a70-8f7d-4eba6dc2f281 tempest-VolumesActionsTest-1998868577 None] Attaching volume d5bea976-9570-47b0-9f04-e224002634f7 to instance 71e4d9ea-5251-421c-a3bf-6dc3e747699f at mountpoint /dev/vdb on host None.
Sep 28 18:16:08 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-aaa2f1a9-b19b-4a70-8f7d-4eba6dc2f281 tempest-VolumesActionsTest-1998868577 None] Attach volume completed successfully.
Sep 28 18:16:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-aaa2f1a9-b19b-4a70-8f7d-4eba6dc2f281 tempest-VolumesActionsTest-1998868577 None] Lock "cinder-d5bea976-9570-47b0-9f04-e224002634f7" released by "attach_volume" :: held 0.151s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:16:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-eb561728-535d-4c6f-8b0b-da9ab15f6a82 tempest-VolumesActionsTest-1998868577 None] Acquiring lock "cinder-d5bea976-9570-47b0-9f04-e224002634f7-detach_volume" by "detach_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:16:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-eb561728-535d-4c6f-8b0b-da9ab15f6a82 tempest-VolumesActionsTest-1998868577 None] Lock "cinder-d5bea976-9570-47b0-9f04-e224002634f7-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:16:09 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-eb561728-535d-4c6f-8b0b-da9ab15f6a82 tempest-VolumesActionsTest-1998868577 None] Detaching volume d5bea976-9570-47b0-9f04-e224002634f7 from instance 71e4d9ea-5251-421c-a3bf-6dc3e747699f.
Sep 28 18:16:09 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-eb561728-535d-4c6f-8b0b-da9ab15f6a82 tempest-VolumesActionsTest-1998868577 None] Detach volume completed successfully.
Sep 28 18:16:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-eb561728-535d-4c6f-8b0b-da9ab15f6a82 tempest-VolumesActionsTest-1998868577 None] Lock "cinder-d5bea976-9570-47b0-9f04-e224002634f7-detach_volume" released by "detach_volume" :: held 0.156s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:16:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-71c81b02-5ca7-4579-a514-5656d31254ec tempest-VolumesActionsTest-1998868577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:16:19 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=5 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:16:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d42a291e-e41d-44bc-9d12-3875dcdadc84 tempest-TestImageHashVerification-2109569672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 46.115s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:16:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d42a291e-e41d-44bc-9d12-3875dcdadc84 tempest-TestImageHashVerification-2109569672 None] Uploaded volume to glance image-id: 5b23b260-0e38-4885-a377-2653c3410f59. {{(pid=87046) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 28 18:16:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-eff39868-d8fe-4676-a49a-c7e4160eaa1c tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 46.072s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:16:22 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-eff39868-d8fe-4676-a49a-c7e4160eaa1c tempest-VolumesDeleteCascade-1102490638 None] Creating offline snapshot 85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc of volume b83842ca-59f6-412d-99dc-c9543b5d00c4 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:16:22 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d42a291e-e41d-44bc-9d12-3875dcdadc84 tempest-TestImageHashVerification-2109569672 None] Copy volume to image completed successfully.
Sep 28 18:16:22 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[334a4e90-7098-4889-a80e-f7028e532ef4]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:16:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-eff39868-d8fe-4676-a49a-c7e4160eaa1c tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:16:22 devstack sudo[99425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4
Sep 28 18:16:22 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:16:22 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root
Sep 28 18:16:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-eff39868-d8fe-4676-a49a-c7e4160eaa1c tempest-VolumesDeleteCascade-1102490638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4" returned: 0 in 0.450s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:16:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-eff39868-d8fe-4676-a49a-c7e4160eaa1c tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:16:22 devstack sudo[99430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc 1G
Sep 28 18:16:22 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:16:23 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root
Sep 28 18:16:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-eff39868-d8fe-4676-a49a-c7e4160eaa1c tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc 1G" returned: 0 in 0.602s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:16:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-eff39868-d8fe-4676-a49a-c7e4160eaa1c tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83842ca-59f6-412d-99dc-c9543b5d00c4 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:16:23 devstack sudo[99437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83842ca-59f6-412d-99dc-c9543b5d00c4 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc
Sep 28 18:16:23 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:16:23 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root
Sep 28 18:16:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-eff39868-d8fe-4676-a49a-c7e4160eaa1c tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83842ca-59f6-412d-99dc-c9543b5d00c4 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc" returned: 0 in 0.426s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:16:23 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-eff39868-d8fe-4676-a49a-c7e4160eaa1c tempest-VolumesDeleteCascade-1102490638 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc is being set with open permissions: ugo+rw
Sep 28 18:16:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-eff39868-d8fe-4676-a49a-c7e4160eaa1c tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:16:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0850994b-2030-4b10-aab7-cd631a072d73 tempest-TestImageHashVerification-2109569672 None] Acquiring lock "cinder-d665fd20-7c70-45a6-9348-326a2b08e81d-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:16:23 devstack sudo[99442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc
Sep 28 18:16:23 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:16:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0850994b-2030-4b10-aab7-cd631a072d73 tempest-TestImageHashVerification-2109569672 None] Lock "cinder-d665fd20-7c70-45a6-9348-326a2b08e81d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:16:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0850994b-2030-4b10-aab7-cd631a072d73 tempest-TestImageHashVerification-2109569672 None] Acquiring lock "cinder-quobyte-d665fd20-7c70-45a6-9348-326a2b08e81d" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:16:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0850994b-2030-4b10-aab7-cd631a072d73 tempest-TestImageHashVerification-2109569672 None] Lock "cinder-quobyte-d665fd20-7c70-45a6-9348-326a2b08e81d" acquired by "delete_volume" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:16:23 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[75658837-aaa3-4ea0-8de7-bfed5fd29751]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:16:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0850994b-2030-4b10-aab7-cd631a072d73 tempest-TestImageHashVerification-2109569672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:16:23 devstack sudo[99444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d
Sep 28 18:16:23 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:16:23 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root
Sep 28 18:16:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-eff39868-d8fe-4676-a49a-c7e4160eaa1c tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc" returned: 0 in 0.392s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:16:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-eff39868-d8fe-4676-a49a-c7e4160eaa1c tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:16:24 devstack sudo[99447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.info
Sep 28 18:16:24 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:16:24 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root
Sep 28 18:16:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0850994b-2030-4b10-aab7-cd631a072d73 tempest-TestImageHashVerification-2109569672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d" returned: 0 in 0.498s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:16:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0850994b-2030-4b10-aab7-cd631a072d73 tempest-TestImageHashVerification-2109569672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:16:24 devstack sudo[99453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d
Sep 28 18:16:24 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:16:24 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root
Sep 28 18:16:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-eff39868-d8fe-4676-a49a-c7e4160eaa1c tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.info" returned: 0 in 0.349s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:16:24 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-eff39868-d8fe-4676-a49a-c7e4160eaa1c tempest-VolumesDeleteCascade-1102490638 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.info is being set with open permissions: ugo+rw
Sep 28 18:16:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-eff39868-d8fe-4676-a49a-c7e4160eaa1c tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:16:24 devstack sudo[99456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.info
Sep 28 18:16:24 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:16:24 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root
Sep 28 18:16:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0850994b-2030-4b10-aab7-cd631a072d73 tempest-TestImageHashVerification-2109569672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d665fd20-7c70-45a6-9348-326a2b08e81d" returned: 0 in 0.330s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:16:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0850994b-2030-4b10-aab7-cd631a072d73 tempest-TestImageHashVerification-2109569672 None] Lock "cinder-quobyte-d665fd20-7c70-45a6-9348-326a2b08e81d" released by "delete_volume" :: held 0.897s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:16:24 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-0850994b-2030-4b10-aab7-cd631a072d73 tempest-TestImageHashVerification-2109569672 None] Created reservations ['adfb189c-2b8a-4c91-b67f-70d118a6b37a', 'bbdec890-4829-4b22-9dbb-5876850c20b8', 'fd3d79af-ffe3-4fbc-b677-d56ca4c6043b', '0129f594-b674-4e5a-9d32-45006dcc14f2'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:16:24 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root
Sep 28 18:16:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-eff39868-d8fe-4676-a49a-c7e4160eaa1c tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.info" returned: 0 in 0.360s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:16:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-eff39868-d8fe-4676-a49a-c7e4160eaa1c tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.738s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:16:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-71c81b02-5ca7-4579-a514-5656d31254ec tempest-VolumesActionsTest-1998868577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 7.174s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:16:24 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b3002e-c6de-49f0-9627-c70ba5574b75]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:16:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-71c81b02-5ca7-4579-a514-5656d31254ec tempest-VolumesActionsTest-1998868577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:16:24 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-eff39868-d8fe-4676-a49a-c7e4160eaa1c tempest-VolumesDeleteCascade-1102490638 None] Create snapshot completed successfully
Sep 28 18:16:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0850994b-2030-4b10-aab7-cd631a072d73 tempest-TestImageHashVerification-2109569672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:16:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0850994b-2030-4b10-aab7-cd631a072d73 tempest-TestImageHashVerification-2109569672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:16:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0850994b-2030-4b10-aab7-cd631a072d73 tempest-TestImageHashVerification-2109569672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:16:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0850994b-2030-4b10-aab7-cd631a072d73 tempest-TestImageHashVerification-2109569672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:16:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0850994b-2030-4b10-aab7-cd631a072d73 tempest-TestImageHashVerification-2109569672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:16:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0850994b-2030-4b10-aab7-cd631a072d73 tempest-TestImageHashVerification-2109569672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:16:24 devstack sudo[99461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:16:24 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:16:24 devstack sudo[99460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7
Sep 28 18:16:24 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:16:25 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root
Sep 28 18:16:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0850994b-2030-4b10-aab7-cd631a072d73 tempest-TestImageHashVerification-2109569672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.316s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:16:25 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-0850994b-2030-4b10-aab7-cd631a072d73 tempest-TestImageHashVerification-2109569672 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:16:25 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-0850994b-2030-4b10-aab7-cd631a072d73 tempest-TestImageHashVerification-2109569672 None] Deleted volume successfully.
Sep 28 18:16:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0850994b-2030-4b10-aab7-cd631a072d73 tempest-TestImageHashVerification-2109569672 None] Lock "cinder-d665fd20-7c70-45a6-9348-326a2b08e81d-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:16:25 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root
Sep 28 18:16:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-71c81b02-5ca7-4579-a514-5656d31254ec tempest-VolumesActionsTest-1998868577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7" returned: 0 in 0.574s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:16:25 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfd8e15-d236-4a86-a5ed-b4c8cc3ec276]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:16:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-71c81b02-5ca7-4579-a514-5656d31254ec tempest-VolumesActionsTest-1998868577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:16:25 devstack sudo[99483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7
Sep 28 18:16:25 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:16:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d14dc96c-eb8c-4b93-881b-325fbb924c7f tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:16:25 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root
Sep 28 18:16:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-71c81b02-5ca7-4579-a514-5656d31254ec tempest-VolumesActionsTest-1998868577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7" returned: 0 in 0.603s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:16:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-71c81b02-5ca7-4579-a514-5656d31254ec tempest-VolumesActionsTest-1998868577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7 /opt/stack/data/cinder/conversion/d5bea976-9570-47b0-9f04-e224002634f7.temp_image.8d54aff9-2c1e-4a9f-9949-0b9a35341c3dfj5ka3kl.img {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:16:26 devstack sudo[99510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7 /opt/stack/data/cinder/conversion/d5bea976-9570-47b0-9f04-e224002634f7.temp_image.8d54aff9-2c1e-4a9f-9949-0b9a35341c3dfj5ka3kl.img
Sep 28 18:16:26 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:16:32 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:16:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Flow 'volume_create_manager' (20fff868-0a82-4ab3-a6b5-24be78da75fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:16:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6667f4-8c79-47a9-aba3-c5355f34543d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6667f4-8c79-47a9-aba3-c5355f34543d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1704534190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4295a05-725d-403c-9e40-ee1105cdb9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8ac573af3742b5a7febc9c35a6057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:32Z,use_quota=True,user_id='46dfea941a274f1a85f70bef0a6c2d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e73ef48-0e2e-4093-bdbc-530e16b2bab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e73ef48-0e2e-4093-bdbc-530e16b2bab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2ad377-a7d8-4b84-bb57-9ae45afd32bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2ad377-a7d8-4b84-bb57-9ae45afd32bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4295a05-725d-403c-9e40-ee1105cdb9ca', 'volume_name': 'volume-e4295a05-725d-403c-9e40-ee1105cdb9ca', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bae6570-6337-43b1-b0dc-8dc087375082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bae6570-6337-43b1-b0dc-8dc087375082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abc06f8-e4be-4941-af7d-6c76df3495b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:32 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Volume e4295a05-725d-403c-9e40-ee1105cdb9ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4295a05-725d-403c-9e40-ee1105cdb9ca', 'volume_size': 1}
Sep 28 18:16:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:16:34 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root
Sep 28 18:16:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-71c81b02-5ca7-4579-a514-5656d31254ec tempest-VolumesActionsTest-1998868577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7 /opt/stack/data/cinder/conversion/d5bea976-9570-47b0-9f04-e224002634f7.temp_image.8d54aff9-2c1e-4a9f-9949-0b9a35341c3dfj5ka3kl.img" returned: 0 in 8.287s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:16:34 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c45e73a-8976-4d14-b672-238641032556]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:16:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-71c81b02-5ca7-4579-a514-5656d31254ec tempest-VolumesActionsTest-1998868577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:16:34 devstack sudo[99527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7
Sep 28 18:16:34 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:16:34 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root
Sep 28 18:16:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-71c81b02-5ca7-4579-a514-5656d31254ec tempest-VolumesActionsTest-1998868577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7" returned: 0 in 0.661s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:16:34 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-71c81b02-5ca7-4579-a514-5656d31254ec tempest-VolumesActionsTest-1998868577 None] Image conversion details: src /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7, size 1024.00 MB, duration 8.29 sec, destination /opt/stack/data/cinder/conversion/d5bea976-9570-47b0-9f04-e224002634f7.temp_image.8d54aff9-2c1e-4a9f-9949-0b9a35341c3dfj5ka3kl.img {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:16:34 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-71c81b02-5ca7-4579-a514-5656d31254ec tempest-VolumesActionsTest-1998868577 None] Converted 1024.00 MB image at 123.55 MB/s
Sep 28 18:16:34 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-71c81b02-5ca7-4579-a514-5656d31254ec tempest-VolumesActionsTest-1998868577 None] 8d54aff9-2c1e-4a9f-9949-0b9a35341c3d was raw, no need to convert to raw {{(pid=87046) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 28 18:16:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:16:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:16:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:16:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:16:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:16:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:16:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:16:39 devstack sudo[99534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:16:39 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:16:39 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root
Sep 28 18:16:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.376s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:16:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:16:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:16:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:16:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:16:44 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=19,cinder:INSERT=3,cinder:UPDATE=14 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:16:44 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=12,cinder:UPDATE=8,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Flow 'volume_create_manager' (0c6cd225-5f67-40b6-a93f-e4d37b2c0370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a2f153-1b04-4152-aab2-e5468794a136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a2f153-1b04-4152-aab2-e5468794a136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1019482089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf08139-ea3d-41db-ab23-b32097c08440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679ff06ed1ae403fa4ca73da6eb0efcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:45Z,use_quota=True,user_id='c163bd48fb4d4d75b2f0c83e4c6b1f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7630ce3a-beb2-400c-a1b0-85cd5acb0604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7630ce3a-beb2-400c-a1b0-85cd5acb0604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35249ac4-9249-4b7a-ae03-e49d45d58efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35249ac4-9249-4b7a-ae03-e49d45d58efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faf08139-ea3d-41db-ab23-b32097c08440', 'volume_name': 'volume-faf08139-ea3d-41db-ab23-b32097c08440', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6237446d-768e-4ef5-9690-d8bcee47829b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6237446d-768e-4ef5-9690-d8bcee47829b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615810c4-d735-462c-ba1f-72a741595bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:45 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Volume faf08139-ea3d-41db-ab23-b32097c08440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faf08139-ea3d-41db-ab23-b32097c08440', 'volume_size': 1}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Flow 'volume_create_manager' (99b383bb-bbce-4d9e-9d42-f4649e03edc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ca46b1-2580-45cd-8777-630130fe1924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ca46b1-2580-45cd-8777-630130fe1924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1000741063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5628c3-6af4-4e91-a077-b97462611457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679ff06ed1ae403fa4ca73da6eb0efcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:46Z,use_quota=True,user_id='c163bd48fb4d4d75b2f0c83e4c6b1f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf92359-22a2-44ef-aa72-cb7e9c14cc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf92359-22a2-44ef-aa72-cb7e9c14cc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c71285-cdc0-4b2c-897c-88f7716bad0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c71285-cdc0-4b2c-897c-88f7716bad0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae5628c3-6af4-4e91-a077-b97462611457', 'volume_name': 'volume-ae5628c3-6af4-4e91-a077-b97462611457', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4996ca2-c37f-47a6-9898-a5075b48293f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4996ca2-c37f-47a6-9898-a5075b48293f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4d43ad-4da0-47a4-806c-00aa221d3f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:45 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Volume ae5628c3-6af4-4e91-a077-b97462611457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae5628c3-6af4-4e91-a077-b97462611457', 'volume_size': 1}
Sep 28 18:16:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:16:46 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:16:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Flow 'volume_create_manager' (1553b2be-52f1-478a-b311-8399d4765e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:16:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76283248-ec0c-41df-888c-c49f76476a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76283248-ec0c-41df-888c-c49f76476a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1349569635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d7b7b2c-d784-4272-ba74-e3e0df6615ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679ff06ed1ae403fa4ca73da6eb0efcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:46Z,use_quota=True,user_id='c163bd48fb4d4d75b2f0c83e4c6b1f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac81509-ac9c-40f5-aa3b-df5dcb7c3489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac81509-ac9c-40f5-aa3b-df5dcb7c3489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08bf94de-d08e-4afa-92c6-10e1866ac7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08bf94de-d08e-4afa-92c6-10e1866ac7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d7b7b2c-d784-4272-ba74-e3e0df6615ef', 'volume_name': 'volume-1d7b7b2c-d784-4272-ba74-e3e0df6615ef', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93353506-fe0a-4282-ac7d-f056582bbc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93353506-fe0a-4282-ac7d-f056582bbc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d42f6f-df7c-4223-8cac-e68243253dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:46 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Volume 1d7b7b2c-d784-4272-ba74-e3e0df6615ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d7b7b2c-d784-4272-ba74-e3e0df6615ef', 'volume_size': 1}
Sep 28 18:16:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:16:46 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:16:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Flow 'volume_create_manager' (87d43598-606a-409d-958d-469c0c92a347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:16:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a903e6-14a0-4ea2-8200-d807c9b33932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a903e6-14a0-4ea2-8200-d807c9b33932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1171592467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75cc4ec-660a-45ce-944b-2d325a707ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679ff06ed1ae403fa4ca73da6eb0efcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:47Z,use_quota=True,user_id='c163bd48fb4d4d75b2f0c83e4c6b1f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a0dc4f-0ba1-4e53-aa05-08922cb37a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a0dc4f-0ba1-4e53-aa05-08922cb37a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad5e1a3-e0f5-407c-8b70-548bd82b8f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad5e1a3-e0f5-407c-8b70-548bd82b8f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f75cc4ec-660a-45ce-944b-2d325a707ba6', 'volume_name': 'volume-f75cc4ec-660a-45ce-944b-2d325a707ba6', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81117ba3-b874-4d62-a58c-a7eb673a47f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81117ba3-b874-4d62-a58c-a7eb673a47f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d77fae-6475-4b70-8707-3bd7a3258369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:47 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Volume f75cc4ec-660a-45ce-944b-2d325a707ba6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f75cc4ec-660a-45ce-944b-2d325a707ba6', 'volume_size': 1}
Sep 28 18:16:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:16:47 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:16:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Flow 'volume_create_manager' (df2bf177-a3a9-497a-8219-6c30aa297a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:16:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9902d1dd-8b2b-4ed8-a88a-5efdde4a4a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9902d1dd-8b2b-4ed8-a88a-5efdde4a4a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2006571765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0492fd6c-b7ee-4efc-9816-3acd1bb7e80a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679ff06ed1ae403fa4ca73da6eb0efcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:47Z,use_quota=True,user_id='c163bd48fb4d4d75b2f0c83e4c6b1f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86852fa8-4e11-4fd9-95a5-ab375d2591ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86852fa8-4e11-4fd9-95a5-ab375d2591ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9ab034-894f-4f98-a3a9-578dc8e0b82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9ab034-894f-4f98-a3a9-578dc8e0b82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0492fd6c-b7ee-4efc-9816-3acd1bb7e80a', 'volume_name': 'volume-0492fd6c-b7ee-4efc-9816-3acd1bb7e80a', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92925446-fbde-4f16-ab9f-fff0eb9425eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92925446-fbde-4f16-ab9f-fff0eb9425eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:16:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f1f6bc-b50e-4f2a-963e-13d4477f6352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:16:47 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Volume 0492fd6c-b7ee-4efc-9816-3acd1bb7e80a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0492fd6c-b7ee-4efc-9816-3acd1bb7e80a', 'volume_size': 1}
Sep 28 18:16:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:16:57 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:16:57 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:UPDATE=2,cinder:SELECT=5 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:16:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-71c81b02-5ca7-4579-a514-5656d31254ec tempest-VolumesActionsTest-1998868577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.215s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:16:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-71c81b02-5ca7-4579-a514-5656d31254ec tempest-VolumesActionsTest-1998868577 None] Uploaded volume to glance image-id: 8d54aff9-2c1e-4a9f-9949-0b9a35341c3d. {{(pid=87046) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 28 18:16:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d14dc96c-eb8c-4b93-881b-325fbb924c7f tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 32.017s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:16:57 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-d14dc96c-eb8c-4b93-881b-325fbb924c7f tempest-VolumesDeleteCascade-1102490638 None] Creating offline snapshot 9b58b6a3-6981-4f43-a622-4d05d53b64fc of volume b83842ca-59f6-412d-99dc-c9543b5d00c4 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:16:58 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-71c81b02-5ca7-4579-a514-5656d31254ec tempest-VolumesActionsTest-1998868577 None] Copy volume to image completed successfully.
Sep 28 18:16:58 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[887fdd3b-bce1-49c1-ab30-34b6e3f1e2d0]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:16:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d14dc96c-eb8c-4b93-881b-325fbb924c7f tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:16:58 devstack sudo[99541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc
Sep 28 18:16:58 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:16:58 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root
Sep 28 18:16:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d14dc96c-eb8c-4b93-881b-325fbb924c7f tempest-VolumesDeleteCascade-1102490638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc" returned: 0 in 0.433s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:16:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-d14dc96c-eb8c-4b93-881b-325fbb924c7f tempest-VolumesDeleteCascade-1102490638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b83842ca-59f6-412d-99dc-c9543b5d00c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:16:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d14dc96c-eb8c-4b93-881b-325fbb924c7f tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:16:58 devstack sudo[99546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc 1G
Sep 28 18:16:58 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:16:59 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root
Sep 28 18:16:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d14dc96c-eb8c-4b93-881b-325fbb924c7f tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc 1G" returned: 0 in 0.597s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:16:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d14dc96c-eb8c-4b93-881b-325fbb924c7f tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:16:59 devstack sudo[99552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc
Sep 28 18:16:59 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:16:59 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root
Sep 28 18:16:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d14dc96c-eb8c-4b93-881b-325fbb924c7f tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc" returned: 0 in 0.371s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:16:59 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-d14dc96c-eb8c-4b93-881b-325fbb924c7f tempest-VolumesDeleteCascade-1102490638 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc is being set with open permissions: ugo+rw
Sep 28 18:16:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d14dc96c-eb8c-4b93-881b-325fbb924c7f tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:16:59 devstack sudo[99557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc
Sep 28 18:16:59 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:16:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:16:59 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root
Sep 28 18:16:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d14dc96c-eb8c-4b93-881b-325fbb924c7f tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc" returned: 0 in 0.363s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:16:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d14dc96c-eb8c-4b93-881b-325fbb924c7f tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:16:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.493s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:16:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1704534190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4295a05-725d-403c-9e40-ee1105cdb9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8ac573af3742b5a7febc9c35a6057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:32Z,use_quota=True,user_id='46dfea941a274f1a85f70bef0a6c2d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:16:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Creating volume e4295a05-725d-403c-9e40-ee1105cdb9ca {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:16:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:16:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:16:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:16:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:16:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:16:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:16:59 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:16:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e4295a05-725d-403c-9e40-ee1105cdb9ca 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:16:59 devstack sudo[99560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e4295a05-725d-403c-9e40-ee1105cdb9ca 1073741824
Sep 28 18:16:59 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:16:59 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d14dc96c-eb8c-4b93-881b-325fbb924c7f tempest-VolumesDeleteCascade-1102490638 None] Create snapshot completed successfully
Sep 28 18:17:00 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e4295a05-725d-403c-9e40-ee1105cdb9ca 1073741824" returned: 0 in 0.609s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e4295a05-725d-403c-9e40-ee1105cdb9ca {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:00 devstack sudo[99566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e4295a05-725d-403c-9e40-ee1105cdb9ca
Sep 28 18:17:00 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "cinder-b83842ca-59f6-412d-99dc-c9543b5d00c4-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-b83842ca-59f6-412d-99dc-c9543b5d00c4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:00 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e4295a05-725d-403c-9e40-ee1105cdb9ca" returned: 0 in 0.337s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.401s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1019482089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf08139-ea3d-41db-ab23-b32097c08440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679ff06ed1ae403fa4ca73da6eb0efcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:45Z,use_quota=True,user_id='c163bd48fb4d4d75b2f0c83e4c6b1f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Creating volume faf08139-ea3d-41db-ab23-b32097c08440 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:17:00 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-faf08139-ea3d-41db-ab23-b32097c08440 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abc06f8-e4be-4941-af7d-6c76df3495b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4295a05-725d-403c-9e40-ee1105cdb9ca', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:00 devstack sudo[99575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-faf08139-ea3d-41db-ab23-b32097c08440 1073741824
Sep 28 18:17:00 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b88992-3101-4ebf-a64b-5b114b222878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:00 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Volume volume-e4295a05-725d-403c-9e40-ee1105cdb9ca (e4295a05-725d-403c-9e40-ee1105cdb9ca): created successfully
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b88992-3101-4ebf-a64b-5b114b222878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Flow 'volume_create_manager' (20fff868-0a82-4ab3-a6b5-24be78da75fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Performing cascade delete. {{(pid=87046) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 28 18:17:00 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-5517e293-d833-4590-a714-f0cdbae99b35 tempest-AttachVolumeNegativeTest-1944680203 None] Created volume successfully.
Sep 28 18:17:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "cinder-85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "cinder-quobyte-b83842ca-59f6-412d-99dc-c9543b5d00c4" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-quobyte-b83842ca-59f6-412d-99dc-c9543b5d00c4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "cinder-quobyte-85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-quobyte-85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Deleting offline snapshot 85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc of volume b83842ca-59f6-412d-99dc-c9543b5d00c4 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] snapshot_file for this snap is: volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b42d91-541b-4653-89a7-368f788f3538]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:01 devstack sudo[99577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc
Sep 28 18:17:01 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:01 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-faf08139-ea3d-41db-ab23-b32097c08440 1073741824" returned: 0 in 0.583s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-faf08139-ea3d-41db-ab23-b32097c08440 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:01 devstack sudo[99588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-faf08139-ea3d-41db-ab23-b32097c08440
Sep 28 18:17:01 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:01 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc" returned: 0 in 0.493s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b83842ca-59f6-412d-99dc-c9543b5d00c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0684c22b-42bf-4510-8cc0-f1523c946ba0]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:01 devstack sudo[99593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4
Sep 28 18:17:01 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:01 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-faf08139-ea3d-41db-ab23-b32097c08440" returned: 0 in 0.365s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.952s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1000741063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5628c3-6af4-4e91-a077-b97462611457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679ff06ed1ae403fa4ca73da6eb0efcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:46Z,use_quota=True,user_id='c163bd48fb4d4d75b2f0c83e4c6b1f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Creating volume ae5628c3-6af4-4e91-a077-b97462611457 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:17:01 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae5628c3-6af4-4e91-a077-b97462611457 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615810c4-d735-462c-ba1f-72a741595bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faf08139-ea3d-41db-ab23-b32097c08440', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:01 devstack sudo[99596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae5628c3-6af4-4e91-a077-b97462611457 1073741824
Sep 28 18:17:01 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:02 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69e704a3-7560-41c7-b199-91a8b2213b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:02 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Volume volume-faf08139-ea3d-41db-ab23-b32097c08440 (faf08139-ea3d-41db-ab23-b32097c08440): created successfully
Sep 28 18:17:02 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69e704a3-7560-41c7-b199-91a8b2213b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:02 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Flow 'volume_create_manager' (0c6cd225-5f67-40b6-a93f-e4d37b2c0370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:17:02 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-16dd9ec6-d885-431d-aa54-bbe794bb7440 tempest-CreateVolumesFromImageTest-559614719 None] Created volume successfully.
Sep 28 18:17:02 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4" returned: 0 in 0.578s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:02 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f14d55-8070-46b4-87de-508a0e4d2eec]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:02 devstack sudo[99602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc
Sep 28 18:17:02 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:02 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae5628c3-6af4-4e91-a077-b97462611457 1073741824" returned: 0 in 0.883s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-d2c2fd95-5f87-48ad-804a-b67418d6d6a6 req-cd39599d-d687-49eb-86a4-fa7296fe83f9 tempest-AttachVolumeNegativeTest-1944680203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:02 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc" returned: 0 in 0.673s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:02 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b83842ca-59f6-412d-99dc-c9543b5d00c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2795e8c3-c86f-408c-b01a-487f54b0cdcc]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:03 devstack sudo[99619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc
Sep 28 18:17:03 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:03 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc" returned: 0 in 0.402s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b83842ca-59f6-412d-99dc-c9543b5d00c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22f69d6-d649-426e-9679-46e4da1f209c]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae5628c3-6af4-4e91-a077-b97462611457 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:03 devstack sudo[99626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae5628c3-6af4-4e91-a077-b97462611457
Sep 28 18:17:03 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:03 devstack sudo[99625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4
Sep 28 18:17:03 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:03 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae5628c3-6af4-4e91-a077-b97462611457" returned: 0 in 0.334s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] <== create_volume: return (1920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.926s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.262s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1349569635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d7b7b2c-d784-4272-ba74-e3e0df6615ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679ff06ed1ae403fa4ca73da6eb0efcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:46Z,use_quota=True,user_id='c163bd48fb4d4d75b2f0c83e4c6b1f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Creating volume 1d7b7b2c-d784-4272-ba74-e3e0df6615ef {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:17:03 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d7b7b2c-d784-4272-ba74-e3e0df6615ef 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4d43ad-4da0-47a4-806c-00aa221d3f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae5628c3-6af4-4e91-a077-b97462611457', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:03 devstack sudo[99633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d7b7b2c-d784-4272-ba74-e3e0df6615ef 1073741824
Sep 28 18:17:03 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77550e34-3f7f-4ced-8890-651bacf4f12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:03 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Volume volume-ae5628c3-6af4-4e91-a077-b97462611457 (ae5628c3-6af4-4e91-a077-b97462611457): created successfully
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77550e34-3f7f-4ced-8890-651bacf4f12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Flow 'volume_create_manager' (99b383bb-bbce-4d9e-9d42-f4649e03edc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:17:03 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4" returned: 0 in 0.490s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:03 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-b8e1e0e5-b8f6-4e05-bf0b-607ad5db3896 tempest-CreateVolumesFromImageTest-559614719 None] Created volume successfully.
Sep 28 18:17:03 devstack sudo[99635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc
Sep 28 18:17:03 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:04 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc" returned: 0 in 0.481s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:04 devstack sudo[99644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc
Sep 28 18:17:04 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:04 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d7b7b2c-d784-4272-ba74-e3e0df6615ef 1073741824" returned: 0 in 0.611s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d7b7b2c-d784-4272-ba74-e3e0df6615ef {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:04 devstack sudo[99646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d7b7b2c-d784-4272-ba74-e3e0df6615ef
Sep 28 18:17:04 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:04 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc" returned: 0 in 0.353s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83842ca-59f6-412d-99dc-c9543b5d00c4 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc -F qcow2 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:04 devstack sudo[99649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83842ca-59f6-412d-99dc-c9543b5d00c4 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc -F qcow2
Sep 28 18:17:04 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:04 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d7b7b2c-d784-4272-ba74-e3e0df6615ef" returned: 0 in 0.362s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.805s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1171592467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75cc4ec-660a-45ce-944b-2d325a707ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679ff06ed1ae403fa4ca73da6eb0efcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:47Z,use_quota=True,user_id='c163bd48fb4d4d75b2f0c83e4c6b1f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Creating volume f75cc4ec-660a-45ce-944b-2d325a707ba6 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:17:04 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f75cc4ec-660a-45ce-944b-2d325a707ba6 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:04 devstack sudo[99652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f75cc4ec-660a-45ce-944b-2d325a707ba6 1073741824
Sep 28 18:17:04 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d42f6f-df7c-4223-8cac-e68243253dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d7b7b2c-d784-4272-ba74-e3e0df6615ef', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2888e9-bd9c-4f30-b5c1-04c3237644b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:04 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Volume volume-1d7b7b2c-d784-4272-ba74-e3e0df6615ef (1d7b7b2c-d784-4272-ba74-e3e0df6615ef): created successfully
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2888e9-bd9c-4f30-b5c1-04c3237644b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:04 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Flow 'volume_create_manager' (1553b2be-52f1-478a-b311-8399d4765e50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:17:05 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-9ecda89b-8915-46a9-998d-36fe4d3282a4 tempest-CreateVolumesFromImageTest-559614719 None] Created volume successfully.
Sep 28 18:17:05 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83842ca-59f6-412d-99dc-c9543b5d00c4 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc -F qcow2" returned: 0 in 0.460s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-quobyte-85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc" released by "_delete_snapshot" :: held 4.191s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-quobyte-b83842ca-59f6-412d-99dc-c9543b5d00c4" released by "delete_snapshot" :: held 4.219s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:05 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Created reservations ['f0f569b2-6fad-4067-afb1-a6478eb655e2', '7c0885ae-800f-4e18-885c-1888b2c01632', 'dac6ab85-64c7-4e60-8493-96056093c73d', '5451820b-6e93-4755-bee7-405bd8f9aeec'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:17:05 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Delete snapshot completed successfully.
Sep 28 18:17:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-85c87aa1-54e7-4e34-a6bb-9c8e26dc9ffc-delete_snapshot" released by "delete_snapshot" :: held 4.450s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "cinder-9b58b6a3-6981-4f43-a622-4d05d53b64fc-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-9b58b6a3-6981-4f43-a622-4d05d53b64fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "cinder-quobyte-b83842ca-59f6-412d-99dc-c9543b5d00c4" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-quobyte-b83842ca-59f6-412d-99dc-c9543b5d00c4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "cinder-quobyte-9b58b6a3-6981-4f43-a622-4d05d53b64fc" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:05 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-quobyte-9b58b6a3-6981-4f43-a622-4d05d53b64fc" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Deleting offline snapshot 9b58b6a3-6981-4f43-a622-4d05d53b64fc of volume b83842ca-59f6-412d-99dc-c9543b5d00c4 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:17:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] snapshot_file for this snap is: volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:17:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f75cc4ec-660a-45ce-944b-2d325a707ba6 1073741824" returned: 0 in 0.698s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:05 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c711db-5c47-478f-be46-5a4dd9f9f641]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f75cc4ec-660a-45ce-944b-2d325a707ba6 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:05 devstack sudo[99670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f75cc4ec-660a-45ce-944b-2d325a707ba6
Sep 28 18:17:05 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:05 devstack sudo[99669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc
Sep 28 18:17:05 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:06 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f75cc4ec-660a-45ce-944b-2d325a707ba6" returned: 0 in 0.408s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.530s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2006571765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0492fd6c-b7ee-4efc-9816-3acd1bb7e80a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679ff06ed1ae403fa4ca73da6eb0efcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:47Z,use_quota=True,user_id='c163bd48fb4d4d75b2f0c83e4c6b1f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Creating volume 0492fd6c-b7ee-4efc-9816-3acd1bb7e80a {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:17:06 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0492fd6c-b7ee-4efc-9816-3acd1bb7e80a 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:06 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc" returned: 0 in 0.477s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b83842ca-59f6-412d-99dc-c9543b5d00c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:17:06 devstack sudo[99677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0492fd6c-b7ee-4efc-9816-3acd1bb7e80a 1073741824
Sep 28 18:17:06 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d77fae-6475-4b70-8707-3bd7a3258369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f75cc4ec-660a-45ce-944b-2d325a707ba6', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7d046b-59f9-4b8a-a1f4-cc5a675c24f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c75ced-5d67-4cca-abde-5dec077fc020]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:06 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Volume volume-f75cc4ec-660a-45ce-944b-2d325a707ba6 (f75cc4ec-660a-45ce-944b-2d325a707ba6): created successfully
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7d046b-59f9-4b8a-a1f4-cc5a675c24f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Flow 'volume_create_manager' (87d43598-606a-409d-958d-469c0c92a347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:17:06 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-298a7354-ca7e-4e1c-85a6-599a132c6347 tempest-CreateVolumesFromImageTest-559614719 None] Created volume successfully.
Sep 28 18:17:06 devstack sudo[99679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4
Sep 28 18:17:06 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:06 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0492fd6c-b7ee-4efc-9816-3acd1bb7e80a 1073741824" returned: 0 in 0.555s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:06 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4" returned: 0 in 0.495s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:06 devstack sudo[99688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc
Sep 28 18:17:06 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0492fd6c-b7ee-4efc-9816-3acd1bb7e80a {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:06 devstack sudo[99690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0492fd6c-b7ee-4efc-9816-3acd1bb7e80a
Sep 28 18:17:06 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:06 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0492fd6c-b7ee-4efc-9816-3acd1bb7e80a" returned: 0 in 0.326s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 7.210s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f1f6bc-b50e-4f2a-963e-13d4477f6352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0492fd6c-b7ee-4efc-9816-3acd1bb7e80a', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bac9896-c1bd-4d6b-b4fb-5b40017dc307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1175e684-9cde-4d91-94a2-cf89b464bad8]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:07 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc" returned: 0 in 0.432s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:07 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Volume volume-0492fd6c-b7ee-4efc-9816-3acd1bb7e80a (0492fd6c-b7ee-4efc-9816-3acd1bb7e80a): created successfully
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bac9896-c1bd-4d6b-b4fb-5b40017dc307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Flow 'volume_create_manager' (df2bf177-a3a9-497a-8219-6c30aa297a86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:17:07 devstack sudo[99697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc
Sep 28 18:17:07 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:07 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-16211250-bae4-4fa2-8a4f-3e34bc76824d tempest-CreateVolumesFromImageTest-559614719 None] Created volume successfully.
Sep 28 18:17:07 devstack sudo[99696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7
Sep 28 18:17:07 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a94e9983-4481-4082-9722-4fa681db37d2 tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "cinder-0492fd6c-b7ee-4efc-9816-3acd1bb7e80a-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a94e9983-4481-4082-9722-4fa681db37d2 tempest-CreateVolumesFromImageTest-559614719 None] Lock "cinder-0492fd6c-b7ee-4efc-9816-3acd1bb7e80a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a94e9983-4481-4082-9722-4fa681db37d2 tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "cinder-quobyte-0492fd6c-b7ee-4efc-9816-3acd1bb7e80a" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:07 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a94e9983-4481-4082-9722-4fa681db37d2 tempest-CreateVolumesFromImageTest-559614719 None] Lock "cinder-quobyte-0492fd6c-b7ee-4efc-9816-3acd1bb7e80a" acquired by "delete_volume" :: waited 0.037s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4.9b58b6a3-6981-4f43-a622-4d05d53b64fc" returned: 0 in 0.414s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e959e1ee-edde-4412-9991-e89bb6c7f9ed]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a94e9983-4481-4082-9722-4fa681db37d2 tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0492fd6c-b7ee-4efc-9816-3acd1bb7e80a {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-quobyte-9b58b6a3-6981-4f43-a622-4d05d53b64fc" released by "_delete_snapshot" :: held 2.000s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-quobyte-b83842ca-59f6-412d-99dc-c9543b5d00c4" released by "delete_snapshot" :: held 2.037s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:07 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7" returned: 0 in 0.580s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Created reservations ['0283c9c7-b52a-44e7-a910-53b098557fd1', 'edfda3a5-bce3-4bac-bf1b-19afcc67751e', '4fbcc640-5fd7-462a-b218-1de84bf40008', 'b27066c7-41ab-4284-b0ab-bfda65ad9957'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[34330139-c011-4391-bc13-06f5a69eb591]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:07 devstack sudo[99703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0492fd6c-b7ee-4efc-9816-3acd1bb7e80a
Sep 28 18:17:07 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:07 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Delete snapshot completed successfully.
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-9b58b6a3-6981-4f43-a622-4d05d53b64fc-delete_snapshot" released by "delete_snapshot" :: held 2.278s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Snapshots deleted, issuing volume delete {{(pid=87046) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "cinder-quobyte-b83842ca-59f6-412d-99dc-c9543b5d00c4" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-quobyte-b83842ca-59f6-412d-99dc-c9543b5d00c4" acquired by "delete_volume" :: waited 0.024s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:07 devstack sudo[99705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7
Sep 28 18:17:07 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f6b19f-316d-434c-8243-32149f476ad1]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:08 devstack sudo[99708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4
Sep 28 18:17:08 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:08 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a94e9983-4481-4082-9722-4fa681db37d2 tempest-CreateVolumesFromImageTest-559614719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0492fd6c-b7ee-4efc-9816-3acd1bb7e80a" returned: 0 in 0.591s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a94e9983-4481-4082-9722-4fa681db37d2 tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0492fd6c-b7ee-4efc-9816-3acd1bb7e80a {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:08 devstack sudo[99715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0492fd6c-b7ee-4efc-9816-3acd1bb7e80a
Sep 28 18:17:08 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:08 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7" returned: 0 in 0.564s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7 /opt/stack/data/cinder/conversion/d5bea976-9570-47b0-9f04-e224002634f7.temp_image.29e43d28-c75d-42e7-b7e8-1131b821f719yq61ndj7.img {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:08 devstack sudo[99718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7 /opt/stack/data/cinder/conversion/d5bea976-9570-47b0-9f04-e224002634f7.temp_image.29e43d28-c75d-42e7-b7e8-1131b821f719yq61ndj7.img
Sep 28 18:17:08 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:08 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4" returned: 0 in 0.534s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:08 devstack sudo[99723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4
Sep 28 18:17:08 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:08 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a94e9983-4481-4082-9722-4fa681db37d2 tempest-CreateVolumesFromImageTest-559614719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0492fd6c-b7ee-4efc-9816-3acd1bb7e80a" returned: 0 in 0.353s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a94e9983-4481-4082-9722-4fa681db37d2 tempest-CreateVolumesFromImageTest-559614719 None] Lock "cinder-quobyte-0492fd6c-b7ee-4efc-9816-3acd1bb7e80a" released by "delete_volume" :: held 1.029s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:08 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-a94e9983-4481-4082-9722-4fa681db37d2 tempest-CreateVolumesFromImageTest-559614719 None] Created reservations ['67616d06-727d-462b-9e97-dff45ab1e155', 'fcf10b25-b86e-4b02-a32c-e7c3919a37af', '2d8d1591-2d64-42d1-8c91-6a6597983ae2', '7df4a4d7-d319-4299-9cbc-1e6cdd11cd6e'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:17:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a94e9983-4481-4082-9722-4fa681db37d2 tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a94e9983-4481-4082-9722-4fa681db37d2 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a94e9983-4481-4082-9722-4fa681db37d2 tempest-CreateVolumesFromImageTest-559614719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a94e9983-4481-4082-9722-4fa681db37d2 tempest-CreateVolumesFromImageTest-559614719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a94e9983-4481-4082-9722-4fa681db37d2 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a94e9983-4481-4082-9722-4fa681db37d2 tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:08 devstack sudo[99733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:17:08 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:08 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b83842ca-59f6-412d-99dc-c9543b5d00c4" returned: 0 in 0.461s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-quobyte-b83842ca-59f6-412d-99dc-c9543b5d00c4" released by "delete_volume" :: held 1.105s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:09 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Created reservations ['6598c5aa-a3a3-4598-8f43-29139da66b28', '6b3b2e18-2f6f-48cf-8cfa-3cc5ca77af16', 'ab98caea-6dd3-4082-98f7-0ffb1fae69e8', 'a5d1a194-0030-4a79-9e54-8208311ae2b7'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:17:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:09 devstack sudo[99739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:17:09 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:09 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a94e9983-4481-4082-9722-4fa681db37d2 tempest-CreateVolumesFromImageTest-559614719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.553s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:09 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-a94e9983-4481-4082-9722-4fa681db37d2 tempest-CreateVolumesFromImageTest-559614719 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:17:09 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-a94e9983-4481-4082-9722-4fa681db37d2 tempest-CreateVolumesFromImageTest-559614719 None] Deleted volume successfully.
Sep 28 18:17:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a94e9983-4481-4082-9722-4fa681db37d2 tempest-CreateVolumesFromImageTest-559614719 None] Lock "cinder-0492fd6c-b7ee-4efc-9816-3acd1bb7e80a-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:09 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.484s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:09 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:17:09 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Deleted volume successfully.
Sep 28 18:17:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-87b4107f-c48a-4521-ad7b-32983f70f356 tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-b83842ca-59f6-412d-99dc-c9543b5d00c4-delete_volume" released by "delete_volume" :: held 8.839s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ec604356-bbd1-4b6f-8105-c53839a7daac tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "cinder-f75cc4ec-660a-45ce-944b-2d325a707ba6-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ec604356-bbd1-4b6f-8105-c53839a7daac tempest-CreateVolumesFromImageTest-559614719 None] Lock "cinder-f75cc4ec-660a-45ce-944b-2d325a707ba6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ec604356-bbd1-4b6f-8105-c53839a7daac tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "cinder-quobyte-f75cc4ec-660a-45ce-944b-2d325a707ba6" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ec604356-bbd1-4b6f-8105-c53839a7daac tempest-CreateVolumesFromImageTest-559614719 None] Lock "cinder-quobyte-f75cc4ec-660a-45ce-944b-2d325a707ba6" acquired by "delete_volume" :: waited 0.029s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:09 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[168de0df-83ef-4e47-a674-b77c90d608c3]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ec604356-bbd1-4b6f-8105-c53839a7daac tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f75cc4ec-660a-45ce-944b-2d325a707ba6 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:10 devstack sudo[99743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f75cc4ec-660a-45ce-944b-2d325a707ba6
Sep 28 18:17:10 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:10 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ec604356-bbd1-4b6f-8105-c53839a7daac tempest-CreateVolumesFromImageTest-559614719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f75cc4ec-660a-45ce-944b-2d325a707ba6" returned: 0 in 0.798s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ec604356-bbd1-4b6f-8105-c53839a7daac tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f75cc4ec-660a-45ce-944b-2d325a707ba6 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:10 devstack sudo[99748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f75cc4ec-660a-45ce-944b-2d325a707ba6
Sep 28 18:17:10 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:11 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ec604356-bbd1-4b6f-8105-c53839a7daac tempest-CreateVolumesFromImageTest-559614719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f75cc4ec-660a-45ce-944b-2d325a707ba6" returned: 0 in 0.696s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ec604356-bbd1-4b6f-8105-c53839a7daac tempest-CreateVolumesFromImageTest-559614719 None] Lock "cinder-quobyte-f75cc4ec-660a-45ce-944b-2d325a707ba6" released by "delete_volume" :: held 1.619s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:11 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-ec604356-bbd1-4b6f-8105-c53839a7daac tempest-CreateVolumesFromImageTest-559614719 None] Created reservations ['a63e5c73-5ef5-4de5-b53a-567329082233', '407c4838-c308-4083-a3f6-6a4a9522dd4c', '72035787-4109-4f52-a93e-49b4b0b0ef5f', 'd8a5228c-003f-4bb4-834b-637f105dadf6'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:17:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ec604356-bbd1-4b6f-8105-c53839a7daac tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ec604356-bbd1-4b6f-8105-c53839a7daac tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:11 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ec604356-bbd1-4b6f-8105-c53839a7daac tempest-CreateVolumesFromImageTest-559614719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ec604356-bbd1-4b6f-8105-c53839a7daac tempest-CreateVolumesFromImageTest-559614719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ec604356-bbd1-4b6f-8105-c53839a7daac tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ec604356-bbd1-4b6f-8105-c53839a7daac tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:12 devstack sudo[99751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:17:12 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:12 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b7968610-17d5-4476-b2fb-433c5deb74a8 tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "cinder-1d7b7b2c-d784-4272-ba74-e3e0df6615ef-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:12 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:17:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Flow 'volume_create_manager' (4b70dd15-86b1-4824-be54-aa479bcd3dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:17:12 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96bdd2b-cb63-46fe-86aa-7659ed14947c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ec604356-bbd1-4b6f-8105-c53839a7daac tempest-CreateVolumesFromImageTest-559614719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.814s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:12 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-ec604356-bbd1-4b6f-8105-c53839a7daac tempest-CreateVolumesFromImageTest-559614719 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:17:12 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b7968610-17d5-4476-b2fb-433c5deb74a8 tempest-CreateVolumesFromImageTest-559614719 None] Lock "cinder-1d7b7b2c-d784-4272-ba74-e3e0df6615ef-delete_volume" acquired by "delete_volume" :: waited 0.189s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:12 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-ec604356-bbd1-4b6f-8105-c53839a7daac tempest-CreateVolumesFromImageTest-559614719 None] Deleted volume successfully.
Sep 28 18:17:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96bdd2b-cb63-46fe-86aa-7659ed14947c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1020809161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9adcda6a-4314-4c12-93a6-d9d8c6c8880c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f136e2110304a278660aed58dbfdbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:13Z,use_quota=True,user_id='852e8cd8184d46e79143cc2f82564760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad369b1a-4341-40e6-ba31-19a1b7547cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad369b1a-4341-40e6-ba31-19a1b7547cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f07f27-2fb3-4f28-8945-2d278490a2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f07f27-2fb3-4f28-8945-2d278490a2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9adcda6a-4314-4c12-93a6-d9d8c6c8880c', 'volume_name': 'volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9bcea3-49b0-4cc4-a78f-23db609bd932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9bcea3-49b0-4cc4-a78f-23db609bd932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409e05c8-bed3-4b81-beeb-c231c1e8b64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:12 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Volume 9adcda6a-4314-4c12-93a6-d9d8c6c8880c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c', 'volume_size': 1}
Sep 28 18:17:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:12 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ec604356-bbd1-4b6f-8105-c53839a7daac tempest-CreateVolumesFromImageTest-559614719 None] Lock "cinder-f75cc4ec-660a-45ce-944b-2d325a707ba6-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:12 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b7968610-17d5-4476-b2fb-433c5deb74a8 tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "cinder-quobyte-1d7b7b2c-d784-4272-ba74-e3e0df6615ef" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:13 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b7968610-17d5-4476-b2fb-433c5deb74a8 tempest-CreateVolumesFromImageTest-559614719 None] Lock "cinder-quobyte-1d7b7b2c-d784-4272-ba74-e3e0df6615ef" acquired by "delete_volume" :: waited 0.027s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:13 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7338243a-2728-4f49-bf46-83484232d474]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7968610-17d5-4476-b2fb-433c5deb74a8 tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d7b7b2c-d784-4272-ba74-e3e0df6615ef {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:13 devstack sudo[99756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d7b7b2c-d784-4272-ba74-e3e0df6615ef
Sep 28 18:17:13 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:13 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7968610-17d5-4476-b2fb-433c5deb74a8 tempest-CreateVolumesFromImageTest-559614719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d7b7b2c-d784-4272-ba74-e3e0df6615ef" returned: 0 in 0.711s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7968610-17d5-4476-b2fb-433c5deb74a8 tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d7b7b2c-d784-4272-ba74-e3e0df6615ef {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:13 devstack sudo[99761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d7b7b2c-d784-4272-ba74-e3e0df6615ef
Sep 28 18:17:13 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:14 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7968610-17d5-4476-b2fb-433c5deb74a8 tempest-CreateVolumesFromImageTest-559614719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1d7b7b2c-d784-4272-ba74-e3e0df6615ef" returned: 0 in 0.380s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:14 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b7968610-17d5-4476-b2fb-433c5deb74a8 tempest-CreateVolumesFromImageTest-559614719 None] Lock "cinder-quobyte-1d7b7b2c-d784-4272-ba74-e3e0df6615ef" released by "delete_volume" :: held 1.164s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:14 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-b7968610-17d5-4476-b2fb-433c5deb74a8 tempest-CreateVolumesFromImageTest-559614719 None] Created reservations ['58055a5b-5059-419d-b092-a8f41a2fef9f', '3eba0a10-17c9-41bc-bc6d-378088b9a429', 'ae0d306e-6b4c-4892-a988-06c38c24c5fb', '7bec07e3-e950-4727-bfa0-e003c73d636e'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:17:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b7968610-17d5-4476-b2fb-433c5deb74a8 tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b7968610-17d5-4476-b2fb-433c5deb74a8 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b7968610-17d5-4476-b2fb-433c5deb74a8 tempest-CreateVolumesFromImageTest-559614719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b7968610-17d5-4476-b2fb-433c5deb74a8 tempest-CreateVolumesFromImageTest-559614719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b7968610-17d5-4476-b2fb-433c5deb74a8 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7968610-17d5-4476-b2fb-433c5deb74a8 tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:14 devstack sudo[99764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:17:14 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:14 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7968610-17d5-4476-b2fb-433c5deb74a8 tempest-CreateVolumesFromImageTest-559614719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.519s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:14 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-b7968610-17d5-4476-b2fb-433c5deb74a8 tempest-CreateVolumesFromImageTest-559614719 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:17:14 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-b7968610-17d5-4476-b2fb-433c5deb74a8 tempest-CreateVolumesFromImageTest-559614719 None] Deleted volume successfully.
Sep 28 18:17:15 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b7968610-17d5-4476-b2fb-433c5deb74a8 tempest-CreateVolumesFromImageTest-559614719 None] Lock "cinder-1d7b7b2c-d784-4272-ba74-e3e0df6615ef-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:15 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-044b8ff6-958d-46c5-b423-c329dd4b9de6 tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "cinder-ae5628c3-6af4-4e91-a077-b97462611457-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:15 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-044b8ff6-958d-46c5-b423-c329dd4b9de6 tempest-CreateVolumesFromImageTest-559614719 None] Lock "cinder-ae5628c3-6af4-4e91-a077-b97462611457-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:15 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-044b8ff6-958d-46c5-b423-c329dd4b9de6 tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "cinder-quobyte-ae5628c3-6af4-4e91-a077-b97462611457" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:15 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-044b8ff6-958d-46c5-b423-c329dd4b9de6 tempest-CreateVolumesFromImageTest-559614719 None] Lock "cinder-quobyte-ae5628c3-6af4-4e91-a077-b97462611457" acquired by "delete_volume" :: waited 0.029s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:15 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0428ea16-2096-4ada-bfd2-1d13661ad7f3]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-044b8ff6-958d-46c5-b423-c329dd4b9de6 tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae5628c3-6af4-4e91-a077-b97462611457 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:15 devstack sudo[99767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae5628c3-6af4-4e91-a077-b97462611457
Sep 28 18:17:15 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:16 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-044b8ff6-958d-46c5-b423-c329dd4b9de6 tempest-CreateVolumesFromImageTest-559614719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae5628c3-6af4-4e91-a077-b97462611457" returned: 0 in 0.706s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-044b8ff6-958d-46c5-b423-c329dd4b9de6 tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae5628c3-6af4-4e91-a077-b97462611457 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:16 devstack sudo[99772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae5628c3-6af4-4e91-a077-b97462611457
Sep 28 18:17:16 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:16 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7 /opt/stack/data/cinder/conversion/d5bea976-9570-47b0-9f04-e224002634f7.temp_image.29e43d28-c75d-42e7-b7e8-1131b821f719yq61ndj7.img" returned: 0 in 8.065s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:16 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b66483d-983e-4c67-897f-c5f2d7ac237c]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:16 devstack sudo[99774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7
Sep 28 18:17:16 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:16 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-044b8ff6-958d-46c5-b423-c329dd4b9de6 tempest-CreateVolumesFromImageTest-559614719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ae5628c3-6af4-4e91-a077-b97462611457" returned: 0 in 0.397s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:16 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-044b8ff6-958d-46c5-b423-c329dd4b9de6 tempest-CreateVolumesFromImageTest-559614719 None] Lock "cinder-quobyte-ae5628c3-6af4-4e91-a077-b97462611457" released by "delete_volume" :: held 1.208s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:16 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-044b8ff6-958d-46c5-b423-c329dd4b9de6 tempest-CreateVolumesFromImageTest-559614719 None] Created reservations ['b24ba926-c684-4522-bf56-ccd0a9fbec2d', '16149553-fa0a-4f09-9266-8e0e98fd20d9', 'e422131a-4949-4169-9336-c80081d19a65', 'ee8888e1-a387-4c96-8357-df538854bc42'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:17:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-044b8ff6-958d-46c5-b423-c329dd4b9de6 tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-044b8ff6-958d-46c5-b423-c329dd4b9de6 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-044b8ff6-958d-46c5-b423-c329dd4b9de6 tempest-CreateVolumesFromImageTest-559614719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-044b8ff6-958d-46c5-b423-c329dd4b9de6 tempest-CreateVolumesFromImageTest-559614719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-044b8ff6-958d-46c5-b423-c329dd4b9de6 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-044b8ff6-958d-46c5-b423-c329dd4b9de6 tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:16 devstack sudo[99779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:17:16 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:16 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7" returned: 0 in 0.688s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:16 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] Image conversion details: src /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7, size 1024.00 MB, duration 8.07 sec, destination /opt/stack/data/cinder/conversion/d5bea976-9570-47b0-9f04-e224002634f7.temp_image.29e43d28-c75d-42e7-b7e8-1131b821f719yq61ndj7.img {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:17:16 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] Converted 1024.00 MB image at 126.94 MB/s
Sep 28 18:17:17 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] 29e43d28-c75d-42e7-b7e8-1131b821f719 was raw, converting to qcow2 {{(pid=87046) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Sep 28 18:17:17 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4165a027-a833-419b-9e8d-5ccee73f31d8]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:17 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d5bea976-9570-47b0-9f04-e224002634f7.temp_image.29e43d28-c75d-42e7-b7e8-1131b821f719yq61ndj7.img {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-044b8ff6-958d-46c5-b423-c329dd4b9de6 tempest-CreateVolumesFromImageTest-559614719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.315s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:17 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-044b8ff6-958d-46c5-b423-c329dd4b9de6 tempest-CreateVolumesFromImageTest-559614719 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:17:17 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-044b8ff6-958d-46c5-b423-c329dd4b9de6 tempest-CreateVolumesFromImageTest-559614719 None] Deleted volume successfully.
Sep 28 18:17:17 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-044b8ff6-958d-46c5-b423-c329dd4b9de6 tempest-CreateVolumesFromImageTest-559614719 None] Lock "cinder-ae5628c3-6af4-4e91-a077-b97462611457-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:17 devstack sudo[99783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d5bea976-9570-47b0-9f04-e224002634f7.temp_image.29e43d28-c75d-42e7-b7e8-1131b821f719yq61ndj7.img
Sep 28 18:17:17 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:17 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d5bea976-9570-47b0-9f04-e224002634f7.temp_image.29e43d28-c75d-42e7-b7e8-1131b821f719yq61ndj7.img" returned: 0 in 0.444s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d5bea976-9570-47b0-9f04-e224002634f7.temp_image.29e43d28-c75d-42e7-b7e8-1131b821f719yq61ndj7.img {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:17 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6b9b3f16-ecf1-43ad-8163-beae83503de8 tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "cinder-faf08139-ea3d-41db-ab23-b32097c08440-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:17 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6b9b3f16-ecf1-43ad-8163-beae83503de8 tempest-CreateVolumesFromImageTest-559614719 None] Lock "cinder-faf08139-ea3d-41db-ab23-b32097c08440-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:17 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6b9b3f16-ecf1-43ad-8163-beae83503de8 tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "cinder-quobyte-faf08139-ea3d-41db-ab23-b32097c08440" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:17 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6b9b3f16-ecf1-43ad-8163-beae83503de8 tempest-CreateVolumesFromImageTest-559614719 None] Lock "cinder-quobyte-faf08139-ea3d-41db-ab23-b32097c08440" acquired by "delete_volume" :: waited 0.024s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:17 devstack sudo[99787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d5bea976-9570-47b0-9f04-e224002634f7.temp_image.29e43d28-c75d-42e7-b7e8-1131b821f719yq61ndj7.img
Sep 28 18:17:17 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:17 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b965bcb-d0ef-4b80-b4f5-b0e70e475dd6]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6b9b3f16-ecf1-43ad-8163-beae83503de8 tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-faf08139-ea3d-41db-ab23-b32097c08440 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:17 devstack sudo[99789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-faf08139-ea3d-41db-ab23-b32097c08440
Sep 28 18:17:17 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:17 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d5bea976-9570-47b0-9f04-e224002634f7.temp_image.29e43d28-c75d-42e7-b7e8-1131b821f719yq61ndj7.img" returned: 1 in 0.445s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d5bea976-9570-47b0-9f04-e224002634f7.temp_image.29e43d28-c75d-42e7-b7e8-1131b821f719yq61ndj7.img' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:17:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d5bea976-9570-47b0-9f04-e224002634f7.temp_image.29e43d28-c75d-42e7-b7e8-1131b821f719yq61ndj7.img /opt/stack/data/cinder/conversion/vol_upload_hq6l2254 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:17 devstack sudo[99794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d5bea976-9570-47b0-9f04-e224002634f7.temp_image.29e43d28-c75d-42e7-b7e8-1131b821f719yq61ndj7.img /opt/stack/data/cinder/conversion/vol_upload_hq6l2254
Sep 28 18:17:17 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:18 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6b9b3f16-ecf1-43ad-8163-beae83503de8 tempest-CreateVolumesFromImageTest-559614719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-faf08139-ea3d-41db-ab23-b32097c08440" returned: 0 in 0.529s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6b9b3f16-ecf1-43ad-8163-beae83503de8 tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-faf08139-ea3d-41db-ab23-b32097c08440 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:18 devstack sudo[99803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-faf08139-ea3d-41db-ab23-b32097c08440
Sep 28 18:17:18 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:18 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d5bea976-9570-47b0-9f04-e224002634f7.temp_image.29e43d28-c75d-42e7-b7e8-1131b821f719yq61ndj7.img /opt/stack/data/cinder/conversion/vol_upload_hq6l2254" returned: 0 in 0.316s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:18 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] Image conversion details: src /opt/stack/data/cinder/conversion/d5bea976-9570-47b0-9f04-e224002634f7.temp_image.29e43d28-c75d-42e7-b7e8-1131b821f719yq61ndj7.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_hq6l2254 {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:17:18 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 28 18:17:18 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[673331f4-d202-46c7-a7d5-b5dda1bf05ef]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hq6l2254 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:18 devstack sudo[99805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hq6l2254
Sep 28 18:17:18 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:18 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6b9b3f16-ecf1-43ad-8163-beae83503de8 tempest-CreateVolumesFromImageTest-559614719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-faf08139-ea3d-41db-ab23-b32097c08440" returned: 0 in 0.286s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:18 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6b9b3f16-ecf1-43ad-8163-beae83503de8 tempest-CreateVolumesFromImageTest-559614719 None] Lock "cinder-quobyte-faf08139-ea3d-41db-ab23-b32097c08440" released by "delete_volume" :: held 0.871s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:18 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-6b9b3f16-ecf1-43ad-8163-beae83503de8 tempest-CreateVolumesFromImageTest-559614719 None] Created reservations ['1b43affa-2415-4615-bc50-fd86fbbd3403', 'a044c10b-f247-48a5-bab7-335586da6867', 'd11d807e-1fa9-4855-857a-471cf5830334', 'a44f9f4a-79c7-4156-90e5-0128a1a365fa'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:17:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6b9b3f16-ecf1-43ad-8163-beae83503de8 tempest-CreateVolumesFromImageTest-559614719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6b9b3f16-ecf1-43ad-8163-beae83503de8 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:18 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6b9b3f16-ecf1-43ad-8163-beae83503de8 tempest-CreateVolumesFromImageTest-559614719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:18 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6b9b3f16-ecf1-43ad-8163-beae83503de8 tempest-CreateVolumesFromImageTest-559614719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6b9b3f16-ecf1-43ad-8163-beae83503de8 tempest-CreateVolumesFromImageTest-559614719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6b9b3f16-ecf1-43ad-8163-beae83503de8 tempest-CreateVolumesFromImageTest-559614719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:18 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hq6l2254" returned: 0 in 0.441s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:18 devstack sudo[99811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:17:18 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:18 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6b9b3f16-ecf1-43ad-8163-beae83503de8 tempest-CreateVolumesFromImageTest-559614719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.320s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:19 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-6b9b3f16-ecf1-43ad-8163-beae83503de8 tempest-CreateVolumesFromImageTest-559614719 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:17:19 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-6b9b3f16-ecf1-43ad-8163-beae83503de8 tempest-CreateVolumesFromImageTest-559614719 None] Deleted volume successfully.
Sep 28 18:17:19 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6b9b3f16-ecf1-43ad-8163-beae83503de8 tempest-CreateVolumesFromImageTest-559614719 None] Lock "cinder-faf08139-ea3d-41db-ab23-b32097c08440-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.639s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] Uploaded volume to glance image-id: 29e43d28-c75d-42e7-b7e8-1131b821f719. {{(pid=87046) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 28 18:17:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-d2c2fd95-5f87-48ad-804a-b67418d6d6a6 req-cd39599d-d687-49eb-86a4-fa7296fe83f9 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 17.701s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-d2c2fd95-5f87-48ad-804a-b67418d6d6a6 req-cd39599d-d687-49eb-86a4-fa7296fe83f9 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.756s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1020809161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9adcda6a-4314-4c12-93a6-d9d8c6c8880c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f136e2110304a278660aed58dbfdbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:13Z,use_quota=True,user_id='852e8cd8184d46e79143cc2f82564760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:17:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Creating volume 9adcda6a-4314-4c12-93a6-d9d8c6c8880c {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:17:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:17:20 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:17:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:20 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-748961db-4660-47d7-aff9-283cd9c9467a tempest-VolumesActionsTest-1998868577 None] Copy volume to image completed successfully.
Sep 28 18:17:20 devstack sudo[99816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c 1073741824
Sep 28 18:17:20 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-d2c2fd95-5f87-48ad-804a-b67418d6d6a6 req-cd39599d-d687-49eb-86a4-fa7296fe83f9 tempest-AttachVolumeNegativeTest-1944680203 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-e4295a05-725d-403c-9e40-ee1105cdb9ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94cc8f7f-f960-4e62-8a6b-2e12b54ff87e', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:17:20 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-d2c2fd95-5f87-48ad-804a-b67418d6d6a6 req-cd39599d-d687-49eb-86a4-fa7296fe83f9 tempest-AttachVolumeNegativeTest-1944680203 None] attachment_update completed successfully.
Sep 28 18:17:21 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c 1073741824" returned: 0 in 0.714s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:21 devstack sudo[100238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c
Sep 28 18:17:21 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:21 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c" returned: 0 in 0.420s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:17:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409e05c8-bed3-4b81-beeb-c231c1e8b64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20328d27-4760-4032-9624-e9cb1265a438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:21 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Volume volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c (9adcda6a-4314-4c12-93a6-d9d8c6c8880c): created successfully
Sep 28 18:17:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20328d27-4760-4032-9624-e9cb1265a438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Flow 'volume_create_manager' (4b70dd15-86b1-4824-be54-aa479bcd3dfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:17:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-83e22cb0-b561-480d-9e40-cc71f2c20e97 tempest-VolumesActionsTest-1998868577 None] Acquiring lock "cinder-d5bea976-9570-47b0-9f04-e224002634f7-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:22 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-f53240d3-0888-4988-a51d-254b191af6c8 tempest-VolumesDeleteCascade-1102490638 None] Created volume successfully.
Sep 28 18:17:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-83e22cb0-b561-480d-9e40-cc71f2c20e97 tempest-VolumesActionsTest-1998868577 None] Lock "cinder-d5bea976-9570-47b0-9f04-e224002634f7-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-83e22cb0-b561-480d-9e40-cc71f2c20e97 tempest-VolumesActionsTest-1998868577 None] Acquiring lock "cinder-quobyte-d5bea976-9570-47b0-9f04-e224002634f7" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-83e22cb0-b561-480d-9e40-cc71f2c20e97 tempest-VolumesActionsTest-1998868577 None] Lock "cinder-quobyte-d5bea976-9570-47b0-9f04-e224002634f7" acquired by "delete_volume" :: waited 0.016s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:22 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e7dd21-7fcc-4945-baed-164a593811f2]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-83e22cb0-b561-480d-9e40-cc71f2c20e97 tempest-VolumesActionsTest-1998868577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:22 devstack sudo[100245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7
Sep 28 18:17:22 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:22 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-83e22cb0-b561-480d-9e40-cc71f2c20e97 tempest-VolumesActionsTest-1998868577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7" returned: 0 in 0.607s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-83e22cb0-b561-480d-9e40-cc71f2c20e97 tempest-VolumesActionsTest-1998868577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:22 devstack sudo[100251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7
Sep 28 18:17:22 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f826c81b-2745-46db-ba70-a4248b9fcdff tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f826c81b-2745-46db-ba70-a4248b9fcdff tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:23 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-f826c81b-2745-46db-ba70-a4248b9fcdff tempest-VolumesDeleteCascade-1102490638 None] Creating offline snapshot 047df713-25f4-4759-a8c8-b60853358816 of volume 9adcda6a-4314-4c12-93a6-d9d8c6c8880c {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:17:23 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bff1a6f-b690-4eaf-8ae1-94e7b2e2aec2]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f826c81b-2745-46db-ba70-a4248b9fcdff tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:23 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-83e22cb0-b561-480d-9e40-cc71f2c20e97 tempest-VolumesActionsTest-1998868577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d5bea976-9570-47b0-9f04-e224002634f7" returned: 0 in 0.481s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-83e22cb0-b561-480d-9e40-cc71f2c20e97 tempest-VolumesActionsTest-1998868577 None] Lock "cinder-quobyte-d5bea976-9570-47b0-9f04-e224002634f7" released by "delete_volume" :: held 1.170s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:23 devstack sudo[100255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c
Sep 28 18:17:23 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:23 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-83e22cb0-b561-480d-9e40-cc71f2c20e97 tempest-VolumesActionsTest-1998868577 None] Created reservations ['6e15ec32-88b1-4bf6-8f99-7ba88b45e4df', '0805ac19-9358-4ae9-b10d-aebb78ddd5ac', '58a89081-39dc-4670-94ee-115ce2c8fcc1', 'f49483e3-2bd6-416b-a3d2-758b3c67e99c'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:17:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-83e22cb0-b561-480d-9e40-cc71f2c20e97 tempest-VolumesActionsTest-1998868577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-83e22cb0-b561-480d-9e40-cc71f2c20e97 tempest-VolumesActionsTest-1998868577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:23 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-83e22cb0-b561-480d-9e40-cc71f2c20e97 tempest-VolumesActionsTest-1998868577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:23 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-83e22cb0-b561-480d-9e40-cc71f2c20e97 tempest-VolumesActionsTest-1998868577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-83e22cb0-b561-480d-9e40-cc71f2c20e97 tempest-VolumesActionsTest-1998868577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-83e22cb0-b561-480d-9e40-cc71f2c20e97 tempest-VolumesActionsTest-1998868577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:23 devstack sudo[100257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:17:23 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:23 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f826c81b-2745-46db-ba70-a4248b9fcdff tempest-VolumesDeleteCascade-1102490638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c" returned: 0 in 0.677s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f826c81b-2745-46db-ba70-a4248b9fcdff tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:23 devstack sudo[100266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816 1G
Sep 28 18:17:23 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:24 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-83e22cb0-b561-480d-9e40-cc71f2c20e97 tempest-VolumesActionsTest-1998868577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.533s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:24 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-83e22cb0-b561-480d-9e40-cc71f2c20e97 tempest-VolumesActionsTest-1998868577 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:17:24 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-83e22cb0-b561-480d-9e40-cc71f2c20e97 tempest-VolumesActionsTest-1998868577 None] Deleted volume successfully.
Sep 28 18:17:24 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-0b2f8825-333c-4f10-9ebe-7bcfa55775d8 req-a500ceb3-9513-4b88-b382-88bc891bc805 tempest-AttachVolumeNegativeTest-1944680203 None] Terminate volume connection completed successfully.
Sep 28 18:17:24 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-0b2f8825-333c-4f10-9ebe-7bcfa55775d8 req-a500ceb3-9513-4b88-b382-88bc891bc805 tempest-AttachVolumeNegativeTest-1944680203 None] Deleting attachment 94cc8f7f-f960-4e62-8a6b-2e12b54ff87e. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:17:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-83e22cb0-b561-480d-9e40-cc71f2c20e97 tempest-VolumesActionsTest-1998868577 None] Lock "cinder-d5bea976-9570-47b0-9f04-e224002634f7-delete_volume" released by "delete_volume" :: held 2.084s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:24 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f826c81b-2745-46db-ba70-a4248b9fcdff tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816 1G" returned: 0 in 0.926s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f826c81b-2745-46db-ba70-a4248b9fcdff tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:24 devstack sudo[100299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816
Sep 28 18:17:24 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:25 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f826c81b-2745-46db-ba70-a4248b9fcdff tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816" returned: 0 in 0.719s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:25 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-f826c81b-2745-46db-ba70-a4248b9fcdff tempest-VolumesDeleteCascade-1102490638 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816 is being set with open permissions: ugo+rw
Sep 28 18:17:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f826c81b-2745-46db-ba70-a4248b9fcdff tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:25 devstack sudo[100309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816
Sep 28 18:17:25 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:26 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f826c81b-2745-46db-ba70-a4248b9fcdff tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816" returned: 0 in 0.783s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f826c81b-2745-46db-ba70-a4248b9fcdff tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:26 devstack sudo[100367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.info
Sep 28 18:17:26 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:26 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f826c81b-2745-46db-ba70-a4248b9fcdff tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.info" returned: 0 in 0.686s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:27 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-f826c81b-2745-46db-ba70-a4248b9fcdff tempest-VolumesDeleteCascade-1102490638 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.info is being set with open permissions: ugo+rw
Sep 28 18:17:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f826c81b-2745-46db-ba70-a4248b9fcdff tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:27 devstack sudo[100373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.info
Sep 28 18:17:27 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:27 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f826c81b-2745-46db-ba70-a4248b9fcdff tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.info" returned: 0 in 0.590s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f826c81b-2745-46db-ba70-a4248b9fcdff tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.611s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:27 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-f826c81b-2745-46db-ba70-a4248b9fcdff tempest-VolumesDeleteCascade-1102490638 None] Create snapshot completed successfully
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Flow 'volume_create_manager' (b71db305-18fb-4675-82a3-e73b15e79108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e0b1fbf-df08-4c1e-a189-131a266d63f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e0b1fbf-df08-4c1e-a189-131a266d63f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-211838880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83274a1-922c-4e9c-9215-b68e9669902b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f136e2110304a278660aed58dbfdbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=047df713-25f4-4759-a8c8-b60853358816,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:29Z,use_quota=True,user_id='852e8cd8184d46e79143cc2f82564760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0a617f-1c93-449a-bfc0-249780185aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0a617f-1c93-449a-bfc0-249780185aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7245bf19-6142-4407-9ebf-1a7424f80519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7245bf19-6142-4407-9ebf-1a7424f80519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd83274a1-922c-4e9c-9215-b68e9669902b', 'volume_name': 'volume-d83274a1-922c-4e9c-9215-b68e9669902b', 'volume_size': 1, 'snapshot_id': '047df713-25f4-4759-a8c8-b60853358816'}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9344b4-bb95-46e3-a4af-01bb31b36ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9344b4-bb95-46e3-a4af-01bb31b36ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f51263-6414-4621-9b02-ae5aed544f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:29 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Volume d83274a1-922c-4e9c-9215-b68e9669902b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d83274a1-922c-4e9c-9215-b68e9669902b', 'volume_size': 1, 'snapshot_id': '047df713-25f4-4759-a8c8-b60853358816'}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "cinder-quobyte-047df713-25f4-4759-a8c8-b60853358816-d83274a1-922c-4e9c-9215-b68e9669902b" by "_create_volume_from_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-quobyte-047df713-25f4-4759-a8c8-b60853358816-d83274a1-922c-4e9c-9215-b68e9669902b" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Creating volume d83274a1-922c-4e9c-9215-b68e9669902b from snapshot 047df713-25f4-4759-a8c8-b60853358816 {{(pid=87046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "cinder-quobyte-d83274a1-922c-4e9c-9215-b68e9669902b" by "_copy_volume_from_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-quobyte-d83274a1-922c-4e9c-9215-b68e9669902b" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] snapshot: 047df713-25f4-4759-a8c8-b60853358816, volume: d83274a1-922c-4e9c-9215-b68e9669902b,  {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf1c6ba-be92-49a1-8255-1c8c60b859a8]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:30 devstack sudo[100380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816
Sep 28 18:17:30 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:30 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816" returned: 0 in 0.516s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:17:30 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2044630b-4247-447c-9217-62ce04b60523]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:30 devstack sudo[100385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c
Sep 28 18:17:30 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:30 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c" returned: 0 in 0.482s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 28 18:17:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Creating direct copy from snapshot {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 28 18:17:30 devstack cinder-volume[87046]: DEBUG cinder.utils [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Path /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d83274a1-922c-4e9c-9215-b68e9669902b not found in is_blk_device check {{(pid=87046) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 28 18:17:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d83274a1-922c-4e9c-9215-b68e9669902b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:31 devstack sudo[100390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d83274a1-922c-4e9c-9215-b68e9669902b
Sep 28 18:17:31 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:33 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-46d0ded9-92c7-48be-9f61-62aa11238822 tempest-AttachVolumeNegativeTest-1944680203 None] Acquiring lock "cinder-e4295a05-725d-403c-9e40-ee1105cdb9ca-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:33 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-46d0ded9-92c7-48be-9f61-62aa11238822 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "cinder-e4295a05-725d-403c-9e40-ee1105cdb9ca-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:33 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-46d0ded9-92c7-48be-9f61-62aa11238822 tempest-AttachVolumeNegativeTest-1944680203 None] Acquiring lock "cinder-quobyte-e4295a05-725d-403c-9e40-ee1105cdb9ca" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:33 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-46d0ded9-92c7-48be-9f61-62aa11238822 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "cinder-quobyte-e4295a05-725d-403c-9e40-ee1105cdb9ca" acquired by "delete_volume" :: waited 0.035s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:34 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12407ba-b263-4fd2-9797-f118dfc7f26a]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46d0ded9-92c7-48be-9f61-62aa11238822 tempest-AttachVolumeNegativeTest-1944680203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e4295a05-725d-403c-9e40-ee1105cdb9ca {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:34 devstack sudo[100404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e4295a05-725d-403c-9e40-ee1105cdb9ca
Sep 28 18:17:34 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:35 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46d0ded9-92c7-48be-9f61-62aa11238822 tempest-AttachVolumeNegativeTest-1944680203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e4295a05-725d-403c-9e40-ee1105cdb9ca" returned: 0 in 1.211s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46d0ded9-92c7-48be-9f61-62aa11238822 tempest-AttachVolumeNegativeTest-1944680203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e4295a05-725d-403c-9e40-ee1105cdb9ca {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:35 devstack sudo[100410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e4295a05-725d-403c-9e40-ee1105cdb9ca
Sep 28 18:17:35 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:36 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46d0ded9-92c7-48be-9f61-62aa11238822 tempest-AttachVolumeNegativeTest-1944680203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e4295a05-725d-403c-9e40-ee1105cdb9ca" returned: 0 in 0.815s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-46d0ded9-92c7-48be-9f61-62aa11238822 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "cinder-quobyte-e4295a05-725d-403c-9e40-ee1105cdb9ca" released by "delete_volume" :: held 2.186s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:36 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-46d0ded9-92c7-48be-9f61-62aa11238822 tempest-AttachVolumeNegativeTest-1944680203 None] Created reservations ['b69ae225-8846-42bd-9a29-0c6079091934', 'e2968472-05f8-491f-b943-fbff8c6a4df3', '3fb54375-01a9-4ba2-90a6-8cf74aca16b2', '569571e3-f536-4868-9f8e-c66469b57bf0'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:17:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-46d0ded9-92c7-48be-9f61-62aa11238822 tempest-AttachVolumeNegativeTest-1944680203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-46d0ded9-92c7-48be-9f61-62aa11238822 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-46d0ded9-92c7-48be-9f61-62aa11238822 tempest-AttachVolumeNegativeTest-1944680203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-46d0ded9-92c7-48be-9f61-62aa11238822 tempest-AttachVolumeNegativeTest-1944680203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-46d0ded9-92c7-48be-9f61-62aa11238822 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46d0ded9-92c7-48be-9f61-62aa11238822 tempest-AttachVolumeNegativeTest-1944680203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:36 devstack sudo[100413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:17:36 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:37 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46d0ded9-92c7-48be-9f61-62aa11238822 tempest-AttachVolumeNegativeTest-1944680203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.825s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:37 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-46d0ded9-92c7-48be-9f61-62aa11238822 tempest-AttachVolumeNegativeTest-1944680203 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:17:37 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-46d0ded9-92c7-48be-9f61-62aa11238822 tempest-AttachVolumeNegativeTest-1944680203 None] Deleted volume successfully.
Sep 28 18:17:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-46d0ded9-92c7-48be-9f61-62aa11238822 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "cinder-e4295a05-725d-403c-9e40-ee1105cdb9ca-delete_volume" released by "delete_volume" :: held 3.826s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2758612f-e985-4904-a7a9-7528301faeb3 tempest-AttachVolumeNegativeTest-1944680203 None] Acquiring lock "cinder-af5baf24-952e-440a-afd5-4c8d13bdf4d9-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2758612f-e985-4904-a7a9-7528301faeb3 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "cinder-af5baf24-952e-440a-afd5-4c8d13bdf4d9-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2758612f-e985-4904-a7a9-7528301faeb3 tempest-AttachVolumeNegativeTest-1944680203 None] Acquiring lock "cinder-quobyte-af5baf24-952e-440a-afd5-4c8d13bdf4d9" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2758612f-e985-4904-a7a9-7528301faeb3 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "cinder-quobyte-af5baf24-952e-440a-afd5-4c8d13bdf4d9" acquired by "delete_volume" :: waited 0.050s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:38 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23c3fc1-ef36-4db2-ace7-cc952979c851]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2758612f-e985-4904-a7a9-7528301faeb3 tempest-AttachVolumeNegativeTest-1944680203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af5baf24-952e-440a-afd5-4c8d13bdf4d9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:38 devstack sudo[100416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af5baf24-952e-440a-afd5-4c8d13bdf4d9
Sep 28 18:17:38 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:39 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2758612f-e985-4904-a7a9-7528301faeb3 tempest-AttachVolumeNegativeTest-1944680203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af5baf24-952e-440a-afd5-4c8d13bdf4d9" returned: 0 in 0.928s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2758612f-e985-4904-a7a9-7528301faeb3 tempest-AttachVolumeNegativeTest-1944680203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af5baf24-952e-440a-afd5-4c8d13bdf4d9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:39 devstack sudo[100422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af5baf24-952e-440a-afd5-4c8d13bdf4d9
Sep 28 18:17:39 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:17:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:39 devstack sudo[100424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:17:39 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:40 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:40 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.736s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2758612f-e985-4904-a7a9-7528301faeb3 tempest-AttachVolumeNegativeTest-1944680203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af5baf24-952e-440a-afd5-4c8d13bdf4d9" returned: 0 in 0.875s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:40 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:17:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2758612f-e985-4904-a7a9-7528301faeb3 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "cinder-quobyte-af5baf24-952e-440a-afd5-4c8d13bdf4d9" released by "delete_volume" :: held 1.925s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:40 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:17:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:17:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:17:40 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-2758612f-e985-4904-a7a9-7528301faeb3 tempest-AttachVolumeNegativeTest-1944680203 None] Created reservations ['ddbe4f20-bc89-4021-9153-e303ae9b92bc', '4938d4ef-b21b-4fdd-9582-3e2599a20eb1', 'e70de09e-7ada-4a06-9aff-cd8c83d28779', 'b131297c-0fff-4417-b584-1eaabb8fe9c0'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:17:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2758612f-e985-4904-a7a9-7528301faeb3 tempest-AttachVolumeNegativeTest-1944680203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2758612f-e985-4904-a7a9-7528301faeb3 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2758612f-e985-4904-a7a9-7528301faeb3 tempest-AttachVolumeNegativeTest-1944680203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2758612f-e985-4904-a7a9-7528301faeb3 tempest-AttachVolumeNegativeTest-1944680203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2758612f-e985-4904-a7a9-7528301faeb3 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2758612f-e985-4904-a7a9-7528301faeb3 tempest-AttachVolumeNegativeTest-1944680203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:40 devstack sudo[100428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:17:40 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2f390480-5df8-4388-a45b-30d8a1a6bcd8 tempest-AttachVolumeNegativeTest-1944680203 None] Acquiring lock "cinder-b840303f-96d8-4b7c-ab2f-97bf63228649-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:41 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2758612f-e985-4904-a7a9-7528301faeb3 tempest-AttachVolumeNegativeTest-1944680203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.659s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:41 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-2758612f-e985-4904-a7a9-7528301faeb3 tempest-AttachVolumeNegativeTest-1944680203 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:17:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2f390480-5df8-4388-a45b-30d8a1a6bcd8 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "cinder-b840303f-96d8-4b7c-ab2f-97bf63228649-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:41 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-2758612f-e985-4904-a7a9-7528301faeb3 tempest-AttachVolumeNegativeTest-1944680203 None] Deleted volume successfully.
Sep 28 18:17:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2758612f-e985-4904-a7a9-7528301faeb3 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "cinder-af5baf24-952e-440a-afd5-4c8d13bdf4d9-delete_volume" released by "delete_volume" :: held 3.233s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2f390480-5df8-4388-a45b-30d8a1a6bcd8 tempest-AttachVolumeNegativeTest-1944680203 None] Acquiring lock "cinder-quobyte-b840303f-96d8-4b7c-ab2f-97bf63228649" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2f390480-5df8-4388-a45b-30d8a1a6bcd8 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "cinder-quobyte-b840303f-96d8-4b7c-ab2f-97bf63228649" acquired by "delete_volume" :: waited 0.055s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:41 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbaa85a-85b1-4e7a-87a3-683d26169560]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f390480-5df8-4388-a45b-30d8a1a6bcd8 tempest-AttachVolumeNegativeTest-1944680203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b840303f-96d8-4b7c-ab2f-97bf63228649 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:41 devstack sudo[100431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b840303f-96d8-4b7c-ab2f-97bf63228649
Sep 28 18:17:41 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:41 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d83274a1-922c-4e9c-9215-b68e9669902b" returned: 0 in 10.942s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:41 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Image conversion details: src /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c, size 1024.00 MB, duration 10.94 sec, destination /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d83274a1-922c-4e9c-9215-b68e9669902b {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:17:41 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Converted 1024.00 MB image at 93.57 MB/s
Sep 28 18:17:41 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d83274a1-922c-4e9c-9215-b68e9669902b is being set with open permissions: ugo+rw
Sep 28 18:17:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d83274a1-922c-4e9c-9215-b68e9669902b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:41 devstack sudo[100433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d83274a1-922c-4e9c-9215-b68e9669902b
Sep 28 18:17:41 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:42 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f390480-5df8-4388-a45b-30d8a1a6bcd8 tempest-AttachVolumeNegativeTest-1944680203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b840303f-96d8-4b7c-ab2f-97bf63228649" returned: 0 in 0.797s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f390480-5df8-4388-a45b-30d8a1a6bcd8 tempest-AttachVolumeNegativeTest-1944680203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b840303f-96d8-4b7c-ab2f-97bf63228649 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:42 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d83274a1-922c-4e9c-9215-b68e9669902b" returned: 0 in 0.411s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:42 devstack sudo[100439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b840303f-96d8-4b7c-ab2f-97bf63228649
Sep 28 18:17:42 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-quobyte-d83274a1-922c-4e9c-9215-b68e9669902b" released by "_copy_volume_from_snapshot" :: held 12.515s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-quobyte-047df713-25f4-4759-a8c8-b60853358816-d83274a1-922c-4e9c-9215-b68e9669902b" released by "_create_volume_from_snapshot" :: held 12.637s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.668s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f51263-6414-4621-9b02-ae5aed544f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d83274a1-922c-4e9c-9215-b68e9669902b', 'volume_size': 1, 'snapshot_id': '047df713-25f4-4759-a8c8-b60853358816'}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93121d09-16d5-4829-8262-80f0f7ded6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:42 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Volume volume-d83274a1-922c-4e9c-9215-b68e9669902b (d83274a1-922c-4e9c-9215-b68e9669902b): created successfully
Sep 28 18:17:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93121d09-16d5-4829-8262-80f0f7ded6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Flow 'volume_create_manager' (b71db305-18fb-4675-82a3-e73b15e79108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:17:42 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-6ee0f4c8-88e5-44e5-9d26-1a5d9ca62311 tempest-VolumesDeleteCascade-1102490638 None] Created volume successfully.
Sep 28 18:17:42 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f390480-5df8-4388-a45b-30d8a1a6bcd8 tempest-AttachVolumeNegativeTest-1944680203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b840303f-96d8-4b7c-ab2f-97bf63228649" returned: 0 in 0.340s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2f390480-5df8-4388-a45b-30d8a1a6bcd8 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "cinder-quobyte-b840303f-96d8-4b7c-ab2f-97bf63228649" released by "delete_volume" :: held 1.232s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:42 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-2f390480-5df8-4388-a45b-30d8a1a6bcd8 tempest-AttachVolumeNegativeTest-1944680203 None] Created reservations ['77e0af48-e7e3-474c-87b0-b0780bfe2711', 'b214ccda-7256-4705-8eac-c0e5d7f99d9f', '47a17bdb-09b6-49a2-a683-c26cb115f669', '8bb3a50c-d5a9-46d2-957b-a9e0db3563bd'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:17:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2f390480-5df8-4388-a45b-30d8a1a6bcd8 tempest-AttachVolumeNegativeTest-1944680203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2f390480-5df8-4388-a45b-30d8a1a6bcd8 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2f390480-5df8-4388-a45b-30d8a1a6bcd8 tempest-AttachVolumeNegativeTest-1944680203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2f390480-5df8-4388-a45b-30d8a1a6bcd8 tempest-AttachVolumeNegativeTest-1944680203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2f390480-5df8-4388-a45b-30d8a1a6bcd8 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f390480-5df8-4388-a45b-30d8a1a6bcd8 tempest-AttachVolumeNegativeTest-1944680203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:42 devstack sudo[100443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:17:42 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:17:43 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Flow 'volume_create_manager' (de78fe9d-3dc0-4741-afd3-61c2f769e7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1932082d-093a-42eb-9690-4e106eb05f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f390480-5df8-4388-a45b-30d8a1a6bcd8 tempest-AttachVolumeNegativeTest-1944680203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.408s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-2f390480-5df8-4388-a45b-30d8a1a6bcd8 tempest-AttachVolumeNegativeTest-1944680203 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1932082d-093a-42eb-9690-4e106eb05f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-461501370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c1e221-5779-4440-b5dc-a1ec1a3534aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5625ee5d1763453a84dd5fbc9671a2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:43Z,use_quota=True,user_id='6dda53d13fdd461ea72a07ed5841ee10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7219697-8c12-454d-b244-2e5c75f2b46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7219697-8c12-454d-b244-2e5c75f2b46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370363bb-a832-419c-98c5-b911b175b16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370363bb-a832-419c-98c5-b911b175b16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06c1e221-5779-4440-b5dc-a1ec1a3534aa', 'volume_name': 'volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f208a255-4d52-420c-bf0a-d95b3daa4970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f208a255-4d52-420c-bf0a-d95b3daa4970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17334018-0481-4f09-99f5-f23a7836973a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:43 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Volume 06c1e221-5779-4440-b5dc-a1ec1a3534aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa', 'volume_size': 1}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-461501370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c1e221-5779-4440-b5dc-a1ec1a3534aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5625ee5d1763453a84dd5fbc9671a2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:43Z,use_quota=True,user_id='6dda53d13fdd461ea72a07ed5841ee10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Creating volume 06c1e221-5779-4440-b5dc-a1ec1a3534aa {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:17:43 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:43 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-2f390480-5df8-4388-a45b-30d8a1a6bcd8 tempest-AttachVolumeNegativeTest-1944680203 None] Deleted volume successfully.
Sep 28 18:17:43 devstack sudo[100446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa 1073741824
Sep 28 18:17:43 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2f390480-5df8-4388-a45b-30d8a1a6bcd8 tempest-AttachVolumeNegativeTest-1944680203 None] Lock "cinder-b840303f-96d8-4b7c-ab2f-97bf63228649-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "cinder-9adcda6a-4314-4c12-93a6-d9d8c6c8880c-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-9adcda6a-4314-4c12-93a6-d9d8c6c8880c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Performing cascade delete. {{(pid=87046) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "cinder-047df713-25f4-4759-a8c8-b60853358816-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-047df713-25f4-4759-a8c8-b60853358816-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "cinder-quobyte-9adcda6a-4314-4c12-93a6-d9d8c6c8880c" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-quobyte-9adcda6a-4314-4c12-93a6-d9d8c6c8880c" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "cinder-quobyte-047df713-25f4-4759-a8c8-b60853358816" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-quobyte-047df713-25f4-4759-a8c8-b60853358816" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Deleting offline snapshot 047df713-25f4-4759-a8c8-b60853358816 of volume 9adcda6a-4314-4c12-93a6-d9d8c6c8880c {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] snapshot_file for this snap is: volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3179b56-a2ae-4c07-8f8b-63b3a63e7cf2]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:43 devstack sudo[100450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816
Sep 28 18:17:43 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:44 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa 1073741824" returned: 0 in 0.697s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:44 devstack sudo[100454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa
Sep 28 18:17:44 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:44 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816" returned: 0 in 0.517s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:17:44 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0fc7b2-8fc3-4cb0-8d39-14a4c74aa884]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:44 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa" returned: 0 in 0.346s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:17:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:44 devstack sudo[100459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c
Sep 28 18:17:44 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17334018-0481-4f09-99f5-f23a7836973a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db1094c-f73c-4567-8df7-9ff2adf15f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:44 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Volume volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa (06c1e221-5779-4440-b5dc-a1ec1a3534aa): created successfully
Sep 28 18:17:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db1094c-f73c-4567-8df7-9ff2adf15f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Flow 'volume_create_manager' (de78fe9d-3dc0-4741-afd3-61c2f769e7ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:17:44 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-30bbab99-194c-4231-b4c8-43e6e8d577a9 tempest-VolumesCloneTest-689498868 None] Created volume successfully.
Sep 28 18:17:45 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c" returned: 0 in 0.749s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:45 devstack sudo[100465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816
Sep 28 18:17:45 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:45 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816" returned: 0 in 0.523s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:45 devstack sudo[100471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816
Sep 28 18:17:45 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:46 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c.047df713-25f4-4759-a8c8-b60853358816" returned: 0 in 0.456s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-quobyte-047df713-25f4-4759-a8c8-b60853358816" released by "_delete_snapshot" :: held 2.390s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-quobyte-9adcda6a-4314-4c12-93a6-d9d8c6c8880c" released by "delete_snapshot" :: held 2.423s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Flow 'volume_create_manager' (e02ac414-a468-4a7c-a535-885ef82a204d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e9049d-f5e6-4072-ad54-b233caefd526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e9049d-f5e6-4072-ad54-b233caefd526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1653062738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bcbbac5-564f-4d88-b39d-9b444d2c9d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5625ee5d1763453a84dd5fbc9671a2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=06c1e221-5779-4440-b5dc-a1ec1a3534aa,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:46Z,use_quota=True,user_id='6dda53d13fdd461ea72a07ed5841ee10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d012f50-f3c7-4482-b837-15184eb17150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d012f50-f3c7-4482-b837-15184eb17150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20528546-30b9-4a16-8de0-75286332a9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Created reservations ['abdf5e4b-5105-464f-855c-76236a5a4812', '10fbd9fd-061b-4937-a263-907e8336bfc2', '960c44be-6d9b-455a-bda8-657fa37d15be', '6463cc7d-d1c3-45dd-9229-0afdd550c29e'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20528546-30b9-4a16-8de0-75286332a9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1bcbbac5-564f-4d88-b39d-9b444d2c9d4f', 'volume_name': 'volume-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f', 'volume_size': 2, 'source_volid': '06c1e221-5779-4440-b5dc-a1ec1a3534aa', 'source_volstatus': 'available'}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6381acd9-e8f9-414d-ae7b-80c68f2df0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6381acd9-e8f9-414d-ae7b-80c68f2df0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (681f0a9d-5cc4-4eaf-bec0-76ed5bd9a719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:17:46 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Volume 1bcbbac5-564f-4d88-b39d-9b444d2c9d4f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f', 'volume_size': 2, 'source_volid': '06c1e221-5779-4440-b5dc-a1ec1a3534aa', 'source_volstatus': 'available'}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:46 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Cloning volume 06c1e221-5779-4440-b5dc-a1ec1a3534aa to volume 1bcbbac5-564f-4d88-b39d-9b444d2c9d4f
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Creating offline snapshot a5788e99-06b7-418e-bc38-b4e996058042 of volume 06c1e221-5779-4440-b5dc-a1ec1a3534aa {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[484324f2-5080-46c9-ae64-d21ca74257e0]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:46 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Delete snapshot completed successfully.
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-047df713-25f4-4759-a8c8-b60853358816-delete_snapshot" released by "delete_snapshot" :: held 2.879s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Snapshots deleted, issuing volume delete {{(pid=87046) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "cinder-quobyte-9adcda6a-4314-4c12-93a6-d9d8c6c8880c" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-quobyte-9adcda6a-4314-4c12-93a6-d9d8c6c8880c" acquired by "delete_volume" :: waited 0.023s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[23be4393-01c7-4882-ab1a-dd44efc51706]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:46 devstack sudo[100475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa
Sep 28 18:17:46 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:46 devstack sudo[100476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c
Sep 28 18:17:46 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:47 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa" returned: 0 in 0.706s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:47 devstack sudo[100486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042 1G
Sep 28 18:17:47 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:47 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c" returned: 0 in 0.627s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:47 devstack sudo[100488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c
Sep 28 18:17:47 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:47 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9adcda6a-4314-4c12-93a6-d9d8c6c8880c" returned: 0 in 0.357s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:47 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-quobyte-9adcda6a-4314-4c12-93a6-d9d8c6c8880c" released by "delete_volume" :: held 1.126s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:47 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Created reservations ['d6c5d19e-5d3d-4391-b7de-1e2fb577dcf2', '49caf8de-8bca-4f1f-b7d3-548c298f5a28', 'ab0336c2-5d40-43df-a885-b0c38bb39b08', 'fbe04e32-e8e3-46d9-8c43-28225d95f475'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:17:47 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042 1G" returned: 0 in 0.619s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:47 devstack sudo[100497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042
Sep 28 18:17:47 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:47 devstack sudo[100499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:17:48 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:48 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042" returned: 0 in 0.472s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:48 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042 is being set with open permissions: ugo+rw
Sep 28 18:17:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:48 devstack sudo[100505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042
Sep 28 18:17:48 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:48 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.451s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:48 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:17:48 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Deleted volume successfully.
Sep 28 18:17:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f7d9ee07-ab80-4071-b6e3-ac2551347bae tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "cinder-d83274a1-922c-4e9c-9215-b68e9669902b-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c6ebb622-ebb0-4957-a2af-e542f8a28dfd tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-9adcda6a-4314-4c12-93a6-d9d8c6c8880c-delete_volume" released by "delete_volume" :: held 4.915s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f7d9ee07-ab80-4071-b6e3-ac2551347bae tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-d83274a1-922c-4e9c-9215-b68e9669902b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f7d9ee07-ab80-4071-b6e3-ac2551347bae tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "cinder-quobyte-d83274a1-922c-4e9c-9215-b68e9669902b" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f7d9ee07-ab80-4071-b6e3-ac2551347bae tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-quobyte-d83274a1-922c-4e9c-9215-b68e9669902b" acquired by "delete_volume" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:48 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[168b0dad-4242-4532-92e0-01f909642c69]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f7d9ee07-ab80-4071-b6e3-ac2551347bae tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d83274a1-922c-4e9c-9215-b68e9669902b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:48 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042" returned: 0 in 0.408s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:48 devstack sudo[100507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d83274a1-922c-4e9c-9215-b68e9669902b
Sep 28 18:17:48 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:48 devstack sudo[100510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.info
Sep 28 18:17:48 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:49 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f7d9ee07-ab80-4071-b6e3-ac2551347bae tempest-VolumesDeleteCascade-1102490638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d83274a1-922c-4e9c-9215-b68e9669902b" returned: 0 in 0.481s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f7d9ee07-ab80-4071-b6e3-ac2551347bae tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d83274a1-922c-4e9c-9215-b68e9669902b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:49 devstack sudo[100515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d83274a1-922c-4e9c-9215-b68e9669902b
Sep 28 18:17:49 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:49 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.info" returned: 0 in 0.425s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:49 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.info is being set with open permissions: ugo+rw
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:49 devstack sudo[100518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.info
Sep 28 18:17:49 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:49 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.info" returned: 0 in 0.389s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:49 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Acquiring lock "cinder-quobyte-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f" by "_copy_volume_from_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f7d9ee07-ab80-4071-b6e3-ac2551347bae tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d83274a1-922c-4e9c-9215-b68e9669902b" returned: 0 in 0.580s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Lock "cinder-quobyte-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f" acquired by "_copy_volume_from_snapshot" :: waited 0.054s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] snapshot: a5788e99-06b7-418e-bc38-b4e996058042, volume: 1bcbbac5-564f-4d88-b39d-9b444d2c9d4f,  {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f7d9ee07-ab80-4071-b6e3-ac2551347bae tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-quobyte-d83274a1-922c-4e9c-9215-b68e9669902b" released by "delete_volume" :: held 1.193s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc7b677-9ada-4026-acfc-7d692185d7f9]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-f7d9ee07-ab80-4071-b6e3-ac2551347bae tempest-VolumesDeleteCascade-1102490638 None] Created reservations ['9c39534b-8759-4e90-953e-68e5540ec321', '73683d37-49d3-48f0-9129-32b677dd4b73', '987cb02c-1748-4f75-b1bb-316e6c84fa83', '05341cb3-a054-4964-b4c7-ddb6984cf510'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:17:49 devstack sudo[100522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042
Sep 28 18:17:49 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f7d9ee07-ab80-4071-b6e3-ac2551347bae tempest-VolumesDeleteCascade-1102490638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f7d9ee07-ab80-4071-b6e3-ac2551347bae tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f7d9ee07-ab80-4071-b6e3-ac2551347bae tempest-VolumesDeleteCascade-1102490638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f7d9ee07-ab80-4071-b6e3-ac2551347bae tempest-VolumesDeleteCascade-1102490638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f7d9ee07-ab80-4071-b6e3-ac2551347bae tempest-VolumesDeleteCascade-1102490638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:17:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f7d9ee07-ab80-4071-b6e3-ac2551347bae tempest-VolumesDeleteCascade-1102490638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:50 devstack sudo[100524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:17:50 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:50 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f7d9ee07-ab80-4071-b6e3-ac2551347bae tempest-VolumesDeleteCascade-1102490638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.343s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:50 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-f7d9ee07-ab80-4071-b6e3-ac2551347bae tempest-VolumesDeleteCascade-1102490638 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:17:50 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-f7d9ee07-ab80-4071-b6e3-ac2551347bae tempest-VolumesDeleteCascade-1102490638 None] Deleted volume successfully.
Sep 28 18:17:50 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042" returned: 0 in 0.585s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:17:50 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f7d9ee07-ab80-4071-b6e3-ac2551347bae tempest-VolumesDeleteCascade-1102490638 None] Lock "cinder-d83274a1-922c-4e9c-9215-b68e9669902b-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:17:50 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bd4d60-598c-4090-8de5-f8cc8eb65107]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:17:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:50 devstack sudo[100531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa
Sep 28 18:17:50 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:50 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root
Sep 28 18:17:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa" returned: 0 in 0.589s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:17:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 28 18:17:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Creating direct copy from snapshot {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 28 18:17:50 devstack cinder-volume[87046]: DEBUG cinder.utils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Path /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f not found in is_blk_device check {{(pid=87046) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 28 18:17:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:17:51 devstack sudo[100536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f
Sep 28 18:17:51 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:17:59 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:UPDATE=140,cinder:SELECT=106,cinder:DELETE=13,cinder:INSERT=39 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:18:00 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=113,cinder:UPDATE=145,cinder:INSERT=33,cinder:DELETE=10 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:18:01 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f" returned: 0 in 10.492s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:01 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Image conversion details: src /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa, size 1024.00 MB, duration 10.49 sec, destination /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:18:01 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Converted 1024.00 MB image at 97.59 MB/s
Sep 28 18:18:01 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f is being set with open permissions: ugo+rw
Sep 28 18:18:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:01 devstack sudo[100557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f
Sep 28 18:18:01 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:01 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f" returned: 0 in 0.370s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Lock "cinder-quobyte-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f" released by "_copy_volume_from_snapshot" :: held 12.173s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Acquiring lock "cinder-quobyte-a5788e99-06b7-418e-bc38-b4e996058042" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Lock "cinder-quobyte-a5788e99-06b7-418e-bc38-b4e996058042" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Deleting offline snapshot a5788e99-06b7-418e-bc38-b4e996058042 of volume 06c1e221-5779-4440-b5dc-a1ec1a3534aa {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:18:02 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] snapshot_file for this snap is: volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:18:02 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-95903b81-b70b-4f10-a9d6-6f24303f3f53 tempest-GroupSnapshotsV319Test-1588090796 None] Group tempest-GroupSnapshotsV319Test-Group-303467500: creating
Sep 28 18:18:02 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd1be1c-3e9d-4441-ab9b-7629188845fc]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:02 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-95903b81-b70b-4f10-a9d6-6f24303f3f53 tempest-GroupSnapshotsV319Test-1588090796 None] Group tempest-GroupSnapshotsV319Test-Group-303467500: created successfully
Sep 28 18:18:02 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-95903b81-b70b-4f10-a9d6-6f24303f3f53 tempest-GroupSnapshotsV319Test-1588090796 None] Create group completed successfully.
Sep 28 18:18:02 devstack sudo[100560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042
Sep 28 18:18:02 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:02 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042" returned: 0 in 0.757s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:02 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:18:02 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3d5f80-a799-4581-9385-4203f921efb0]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:03 devstack sudo[100566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa
Sep 28 18:18:03 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:03 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa" returned: 0 in 0.985s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:03 devstack sudo[100572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042
Sep 28 18:18:03 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Flow 'volume_create_manager' (9a3d7044-2b4a-4c6b-9317-7baadea3b28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc386c9-bdf1-470a-a058-eaae90c99735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc386c9-bdf1-470a-a058-eaae90c99735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1489626248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=653a71b9-e093-4b3b-9170-b64c9a842321,host='devstack@QuobyteHD#QuobyteHD',id=71d24f2a-8117-4a8b-8b96-a4e4dc85928c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b2e3b7048f64a19bfbf4a162be5b152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:04Z,use_quota=True,user_id='44acab020611410790e732973ca1e7d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62d4dab1-eef4-45a3-949b-d50468f1bdfa),volume_type_id=62d4dab1-eef4-45a3-949b-d50468f1bdfa)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989a173f-40db-44ab-9f67-1f74107864d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989a173f-40db-44ab-9f67-1f74107864d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb58b14-687d-4c33-9212-23c77e9213ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb58b14-687d-4c33-9212-23c77e9213ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71d24f2a-8117-4a8b-8b96-a4e4dc85928c', 'volume_name': 'volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40a65e0-8035-4015-872e-6a9171c58ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40a65e0-8035-4015-872e-6a9171c58ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125fb35c-1afb-4125-89bd-62d050f4f9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:04 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Volume 71d24f2a-8117-4a8b-8b96-a4e4dc85928c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c', 'volume_size': 1}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:04 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042" returned: 0 in 0.634s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:04 devstack sudo[100577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042
Sep 28 18:18:04 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:04 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa.a5788e99-06b7-418e-bc38-b4e996058042" returned: 0 in 0.367s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Lock "cinder-quobyte-a5788e99-06b7-418e-bc38-b4e996058042" released by "_delete_snapshot" :: held 2.921s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.531s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.708s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=653a71b9-e093-4b3b-9170-b64c9a842321,created_at=2026-09-28T16:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1489626248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=653a71b9-e093-4b3b-9170-b64c9a842321,host='devstack@QuobyteHD#QuobyteHD',id=71d24f2a-8117-4a8b-8b96-a4e4dc85928c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b2e3b7048f64a19bfbf4a162be5b152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:04Z,use_quota=True,user_id='44acab020611410790e732973ca1e7d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62d4dab1-eef4-45a3-949b-d50468f1bdfa),volume_type_id=62d4dab1-eef4-45a3-949b-d50468f1bdfa)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Creating volume 71d24f2a-8117-4a8b-8b96-a4e4dc85928c {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:18:04 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:18:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:05 devstack sudo[100580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c 1073741824
Sep 28 18:18:05 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (681f0a9d-5cc4-4eaf-bec0-76ed5bd9a719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f', 'volume_size': 2, 'source_volid': '06c1e221-5779-4440-b5dc-a1ec1a3534aa', 'source_volstatus': 'available'}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b89679e2-9d80-4c60-8909-2efb3743b343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:05 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Volume volume-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f (1bcbbac5-564f-4d88-b39d-9b444d2c9d4f): created successfully
Sep 28 18:18:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b89679e2-9d80-4c60-8909-2efb3743b343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Flow 'volume_create_manager' (e02ac414-a468-4a7c-a535-885ef82a204d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:05 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-20341614-7d45-443b-b435-80a90a48c800 tempest-VolumesCloneTest-689498868 None] Created volume successfully.
Sep 28 18:18:05 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c 1073741824" returned: 0 in 0.672s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:05 devstack sudo[100587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c
Sep 28 18:18:05 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:06 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c" returned: 0 in 0.372s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125fb35c-1afb-4125-89bd-62d050f4f9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4fc44b-d0a7-4f36-ae69-d3653ed22499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:06 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Volume volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c (71d24f2a-8117-4a8b-8b96-a4e4dc85928c): created successfully
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4fc44b-d0a7-4f36-ae69-d3653ed22499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Flow 'volume_create_manager' (9a3d7044-2b4a-4c6b-9317-7baadea3b28b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:06 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-48bfd92c-9c9b-401e-99a6-cfd77f2c7696 tempest-GroupSnapshotsV319Test-1588090796 None] Created volume successfully.
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-08fc842b-eb8d-42ce-9065-726d1c3df45b tempest-VolumesCloneTest-689498868 None] Acquiring lock "cinder-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-08fc842b-eb8d-42ce-9065-726d1c3df45b tempest-VolumesCloneTest-689498868 None] Lock "cinder-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-08fc842b-eb8d-42ce-9065-726d1c3df45b tempest-VolumesCloneTest-689498868 None] Acquiring lock "cinder-quobyte-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-08fc842b-eb8d-42ce-9065-726d1c3df45b tempest-VolumesCloneTest-689498868 None] Lock "cinder-quobyte-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f" acquired by "delete_volume" :: waited 0.019s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68d1505-cf14-44b4-bb70-db167b649413]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-08fc842b-eb8d-42ce-9065-726d1c3df45b tempest-VolumesCloneTest-689498868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:06 devstack sudo[100590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f
Sep 28 18:18:06 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Flow 'volume_create_manager' (120d0f87-2175-4802-affb-2f5f36094b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57528951-6b01-42e3-beb6-9bd8c9215dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57528951-6b01-42e3-beb6-9bd8c9215dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-982153131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c64bf53-7158-4cad-b9cb-75d7c4d1322f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f192e57e5ccb4868868b0b63d884c275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:07Z,use_quota=True,user_id='3849c96b303b42ff9b431d42df6549e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ed6a4c-b87d-4507-a47e-3b28e029b144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ed6a4c-b87d-4507-a47e-3b28e029b144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d47aec4-0f56-4ea6-be3f-c46cabe6c096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d47aec4-0f56-4ea6-be3f-c46cabe6c096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c64bf53-7158-4cad-b9cb-75d7c4d1322f', 'volume_name': 'volume-2c64bf53-7158-4cad-b9cb-75d7c4d1322f', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53df7934-42cb-4ce7-a35d-682a866dfa98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53df7934-42cb-4ce7-a35d-682a866dfa98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df1b064-a3ff-42d3-bd3a-7fd8552d25cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:06 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Volume 2c64bf53-7158-4cad-b9cb-75d7c4d1322f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c64bf53-7158-4cad-b9cb-75d7c4d1322f', 'volume_size': 1}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-982153131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c64bf53-7158-4cad-b9cb-75d7c4d1322f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f192e57e5ccb4868868b0b63d884c275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:07Z,use_quota=True,user_id='3849c96b303b42ff9b431d42df6549e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Creating volume 2c64bf53-7158-4cad-b9cb-75d7c4d1322f {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:18:06 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:18:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2c64bf53-7158-4cad-b9cb-75d7c4d1322f 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:07 devstack sudo[100593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2c64bf53-7158-4cad-b9cb-75d7c4d1322f 1073741824
Sep 28 18:18:07 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:07 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-94bf3cd4-9a9c-4883-8785-306e6cf14840 tempest-GroupSnapshotsV319Test-1588090796 None] GroupSnapshot f0bcaa76-db2e-4aff-a5a3-8c5ca9c55be4: creating.
Sep 28 18:18:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-94bf3cd4-9a9c-4883-8785-306e6cf14840 tempest-GroupSnapshotsV319Test-1588090796 None] Group snapshot f0bcaa76-db2e-4aff-a5a3-8c5ca9c55be4: creating. {{(pid=87046) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 28 18:18:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-94bf3cd4-9a9c-4883-8785-306e6cf14840 tempest-GroupSnapshotsV319Test-1588090796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:07 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-08fc842b-eb8d-42ce-9065-726d1c3df45b tempest-VolumesCloneTest-689498868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f" returned: 0 in 0.685s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-08fc842b-eb8d-42ce-9065-726d1c3df45b tempest-VolumesCloneTest-689498868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:07 devstack sudo[100599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f
Sep 28 18:18:07 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:07 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-08fc842b-eb8d-42ce-9065-726d1c3df45b tempest-VolumesCloneTest-689498868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f" returned: 0 in 0.315s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-08fc842b-eb8d-42ce-9065-726d1c3df45b tempest-VolumesCloneTest-689498868 None] Lock "cinder-quobyte-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f" released by "delete_volume" :: held 1.076s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:07 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2c64bf53-7158-4cad-b9cb-75d7c4d1322f 1073741824" returned: 0 in 0.749s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:07 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-08fc842b-eb8d-42ce-9065-726d1c3df45b tempest-VolumesCloneTest-689498868 None] Created reservations ['f504a282-92ed-469a-a983-26af0e37a727', 'face13f8-e1b1-48c0-ac76-0c31eebe6753', '2deea314-597f-4096-8034-427e51130b81', 'f2841e32-66b7-4915-b5b3-5ed1031bc081'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:18:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2c64bf53-7158-4cad-b9cb-75d7c4d1322f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:07 devstack sudo[100606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2c64bf53-7158-4cad-b9cb-75d7c4d1322f
Sep 28 18:18:07 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-08fc842b-eb8d-42ce-9065-726d1c3df45b tempest-VolumesCloneTest-689498868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-08fc842b-eb8d-42ce-9065-726d1c3df45b tempest-VolumesCloneTest-689498868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:07 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-08fc842b-eb8d-42ce-9065-726d1c3df45b tempest-VolumesCloneTest-689498868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:07 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-08fc842b-eb8d-42ce-9065-726d1c3df45b tempest-VolumesCloneTest-689498868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-08fc842b-eb8d-42ce-9065-726d1c3df45b tempest-VolumesCloneTest-689498868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-08fc842b-eb8d-42ce-9065-726d1c3df45b tempest-VolumesCloneTest-689498868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:07 devstack sudo[100608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:18:07 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:08 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2c64bf53-7158-4cad-b9cb-75d7c4d1322f" returned: 0 in 0.339s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:18:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-94bf3cd4-9a9c-4883-8785-306e6cf14840 tempest-GroupSnapshotsV319Test-1588090796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.882s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df1b064-a3ff-42d3-bd3a-7fd8552d25cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c64bf53-7158-4cad-b9cb-75d7c4d1322f', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b499ce-8a49-4d43-96ca-4eb096edf7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-94bf3cd4-9a9c-4883-8785-306e6cf14840 tempest-GroupSnapshotsV319Test-1588090796 None] Creating offline snapshot 99098593-d625-45e0-90cb-67c72b631053 of volume 71d24f2a-8117-4a8b-8b96-a4e4dc85928c {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:18:08 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Volume volume-2c64bf53-7158-4cad-b9cb-75d7c4d1322f (2c64bf53-7158-4cad-b9cb-75d7c4d1322f): created successfully
Sep 28 18:18:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b499ce-8a49-4d43-96ca-4eb096edf7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Flow 'volume_create_manager' (120d0f87-2175-4802-affb-2f5f36094b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:08 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[62edab0d-4985-4a69-98db-576e7c952a54]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-94bf3cd4-9a9c-4883-8785-306e6cf14840 tempest-GroupSnapshotsV319Test-1588090796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:08 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-08fc842b-eb8d-42ce-9065-726d1c3df45b tempest-VolumesCloneTest-689498868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.332s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:08 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-08fc842b-eb8d-42ce-9065-726d1c3df45b tempest-VolumesCloneTest-689498868 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:18:08 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-82fa34b9-62a8-4789-96cf-6ead91ef65d3 tempest-VolumesTransfersV355Test-531812068 None] Created volume successfully.
Sep 28 18:18:08 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-08fc842b-eb8d-42ce-9065-726d1c3df45b tempest-VolumesCloneTest-689498868 None] Deleted volume successfully.
Sep 28 18:18:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-08fc842b-eb8d-42ce-9065-726d1c3df45b tempest-VolumesCloneTest-689498868 None] Lock "cinder-1bcbbac5-564f-4d88-b39d-9b444d2c9d4f-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:08 devstack sudo[100612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c
Sep 28 18:18:08 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:08 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-94bf3cd4-9a9c-4883-8785-306e6cf14840 tempest-GroupSnapshotsV319Test-1588090796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c" returned: 0 in 0.551s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-94bf3cd4-9a9c-4883-8785-306e6cf14840 tempest-GroupSnapshotsV319Test-1588090796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.99098593-d625-45e0-90cb-67c72b631053 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:08 devstack sudo[100617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.99098593-d625-45e0-90cb-67c72b631053 1G
Sep 28 18:18:08 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ca2c82ec-81bb-409b-b1f5-d7bb00a5b3d7 tempest-VolumesCloneTest-689498868 None] Acquiring lock "cinder-06c1e221-5779-4440-b5dc-a1ec1a3534aa-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ca2c82ec-81bb-409b-b1f5-d7bb00a5b3d7 tempest-VolumesCloneTest-689498868 None] Lock "cinder-06c1e221-5779-4440-b5dc-a1ec1a3534aa-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ca2c82ec-81bb-409b-b1f5-d7bb00a5b3d7 tempest-VolumesCloneTest-689498868 None] Acquiring lock "cinder-quobyte-06c1e221-5779-4440-b5dc-a1ec1a3534aa" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ca2c82ec-81bb-409b-b1f5-d7bb00a5b3d7 tempest-VolumesCloneTest-689498868 None] Lock "cinder-quobyte-06c1e221-5779-4440-b5dc-a1ec1a3534aa" acquired by "delete_volume" :: waited 0.015s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:09 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8273d46-76fe-4acb-a154-d76ead19f030]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ca2c82ec-81bb-409b-b1f5-d7bb00a5b3d7 tempest-VolumesCloneTest-689498868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:09 devstack sudo[100619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa
Sep 28 18:18:09 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:09 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-94bf3cd4-9a9c-4883-8785-306e6cf14840 tempest-GroupSnapshotsV319Test-1588090796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.99098593-d625-45e0-90cb-67c72b631053 1G" returned: 0 in 0.692s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-94bf3cd4-9a9c-4883-8785-306e6cf14840 tempest-GroupSnapshotsV319Test-1588090796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.99098593-d625-45e0-90cb-67c72b631053 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:09 devstack sudo[100627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.99098593-d625-45e0-90cb-67c72b631053
Sep 28 18:18:09 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:09 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ca2c82ec-81bb-409b-b1f5-d7bb00a5b3d7 tempest-VolumesCloneTest-689498868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa" returned: 0 in 0.573s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ca2c82ec-81bb-409b-b1f5-d7bb00a5b3d7 tempest-VolumesCloneTest-689498868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:09 devstack sudo[100630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa
Sep 28 18:18:09 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:09 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-bcb3f0cd-1901-4ae2-b784-91c4b16107ba tempest-VolumesTransfersV355Test-921153886 None] Transfer volume completed successfully.
Sep 28 18:18:09 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-94bf3cd4-9a9c-4883-8785-306e6cf14840 tempest-GroupSnapshotsV319Test-1588090796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.99098593-d625-45e0-90cb-67c72b631053" returned: 0 in 0.441s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:09 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-94bf3cd4-9a9c-4883-8785-306e6cf14840 tempest-GroupSnapshotsV319Test-1588090796 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.99098593-d625-45e0-90cb-67c72b631053 is being set with open permissions: ugo+rw: NotImplementedError
Sep 28 18:18:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-94bf3cd4-9a9c-4883-8785-306e6cf14840 tempest-GroupSnapshotsV319Test-1588090796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.99098593-d625-45e0-90cb-67c72b631053 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:10 devstack sudo[100635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.99098593-d625-45e0-90cb-67c72b631053
Sep 28 18:18:10 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:10 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ca2c82ec-81bb-409b-b1f5-d7bb00a5b3d7 tempest-VolumesCloneTest-689498868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-06c1e221-5779-4440-b5dc-a1ec1a3534aa" returned: 0 in 0.475s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:10 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ca2c82ec-81bb-409b-b1f5-d7bb00a5b3d7 tempest-VolumesCloneTest-689498868 None] Lock "cinder-quobyte-06c1e221-5779-4440-b5dc-a1ec1a3534aa" released by "delete_volume" :: held 1.144s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:10 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-ca2c82ec-81bb-409b-b1f5-d7bb00a5b3d7 tempest-VolumesCloneTest-689498868 None] Created reservations ['65a3f69c-febe-42ef-8b27-0f940d6c798a', '8bd0720d-d3ea-4b59-ae37-d9d002b353b4', '565c2572-65aa-4ced-90b8-2fe45ab0f5e6', '1ef4f318-ec67-4269-86bc-4ae0882b7fb7'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:18:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ca2c82ec-81bb-409b-b1f5-d7bb00a5b3d7 tempest-VolumesCloneTest-689498868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ca2c82ec-81bb-409b-b1f5-d7bb00a5b3d7 tempest-VolumesCloneTest-689498868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:10 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ca2c82ec-81bb-409b-b1f5-d7bb00a5b3d7 tempest-VolumesCloneTest-689498868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:10 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ca2c82ec-81bb-409b-b1f5-d7bb00a5b3d7 tempest-VolumesCloneTest-689498868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ca2c82ec-81bb-409b-b1f5-d7bb00a5b3d7 tempest-VolumesCloneTest-689498868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ca2c82ec-81bb-409b-b1f5-d7bb00a5b3d7 tempest-VolumesCloneTest-689498868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:10 devstack sudo[100638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:18:10 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:10 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-94bf3cd4-9a9c-4883-8785-306e6cf14840 tempest-GroupSnapshotsV319Test-1588090796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.99098593-d625-45e0-90cb-67c72b631053" returned: 0 in 0.460s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-94bf3cd4-9a9c-4883-8785-306e6cf14840 tempest-GroupSnapshotsV319Test-1588090796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:10 devstack sudo[100641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.info
Sep 28 18:18:10 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:10 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-17c81a44-1418-4c3f-980b-3ede44f0edf2 tempest-VolumesTransfersV355Test-187805454 None] Acquiring lock "cinder-2c64bf53-7158-4cad-b9cb-75d7c4d1322f-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:10 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ca2c82ec-81bb-409b-b1f5-d7bb00a5b3d7 tempest-VolumesCloneTest-689498868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.317s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:10 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-ca2c82ec-81bb-409b-b1f5-d7bb00a5b3d7 tempest-VolumesCloneTest-689498868 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:18:10 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-ca2c82ec-81bb-409b-b1f5-d7bb00a5b3d7 tempest-VolumesCloneTest-689498868 None] Deleted volume successfully.
Sep 28 18:18:10 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-17c81a44-1418-4c3f-980b-3ede44f0edf2 tempest-VolumesTransfersV355Test-187805454 None] Lock "cinder-2c64bf53-7158-4cad-b9cb-75d7c4d1322f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:10 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ca2c82ec-81bb-409b-b1f5-d7bb00a5b3d7 tempest-VolumesCloneTest-689498868 None] Lock "cinder-06c1e221-5779-4440-b5dc-a1ec1a3534aa-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:10 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-17c81a44-1418-4c3f-980b-3ede44f0edf2 tempest-VolumesTransfersV355Test-187805454 None] Acquiring lock "cinder-quobyte-2c64bf53-7158-4cad-b9cb-75d7c4d1322f" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:10 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-17c81a44-1418-4c3f-980b-3ede44f0edf2 tempest-VolumesTransfersV355Test-187805454 None] Lock "cinder-quobyte-2c64bf53-7158-4cad-b9cb-75d7c4d1322f" acquired by "delete_volume" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:10 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[73058a2c-c6c6-45b6-9aaf-79b0ad9a91cb]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-17c81a44-1418-4c3f-980b-3ede44f0edf2 tempest-VolumesTransfersV355Test-187805454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2c64bf53-7158-4cad-b9cb-75d7c4d1322f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:10 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-94bf3cd4-9a9c-4883-8785-306e6cf14840 tempest-GroupSnapshotsV319Test-1588090796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.info" returned: 0 in 0.445s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:10 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-94bf3cd4-9a9c-4883-8785-306e6cf14840 tempest-GroupSnapshotsV319Test-1588090796 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 28 18:18:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-94bf3cd4-9a9c-4883-8785-306e6cf14840 tempest-GroupSnapshotsV319Test-1588090796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:10 devstack sudo[100645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2c64bf53-7158-4cad-b9cb-75d7c4d1322f
Sep 28 18:18:10 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:10 devstack sudo[100646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.info
Sep 28 18:18:10 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:11 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-94bf3cd4-9a9c-4883-8785-306e6cf14840 tempest-GroupSnapshotsV319Test-1588090796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.info" returned: 0 in 0.322s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-94bf3cd4-9a9c-4883-8785-306e6cf14840 tempest-GroupSnapshotsV319Test-1588090796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.095s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:11 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-17c81a44-1418-4c3f-980b-3ede44f0edf2 tempest-VolumesTransfersV355Test-187805454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2c64bf53-7158-4cad-b9cb-75d7c4d1322f" returned: 0 in 0.548s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-17c81a44-1418-4c3f-980b-3ede44f0edf2 tempest-VolumesTransfersV355Test-187805454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2c64bf53-7158-4cad-b9cb-75d7c4d1322f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:11 devstack sudo[100654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2c64bf53-7158-4cad-b9cb-75d7c4d1322f
Sep 28 18:18:11 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:11 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-94bf3cd4-9a9c-4883-8785-306e6cf14840 tempest-GroupSnapshotsV319Test-1588090796 None] group_snapshot f0bcaa76-db2e-4aff-a5a3-8c5ca9c55be4: created successfully
Sep 28 18:18:11 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-17c81a44-1418-4c3f-980b-3ede44f0edf2 tempest-VolumesTransfersV355Test-187805454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2c64bf53-7158-4cad-b9cb-75d7c4d1322f" returned: 0 in 0.633s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-17c81a44-1418-4c3f-980b-3ede44f0edf2 tempest-VolumesTransfersV355Test-187805454 None] Lock "cinder-quobyte-2c64bf53-7158-4cad-b9cb-75d7c4d1322f" released by "delete_volume" :: held 1.259s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:12 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-17c81a44-1418-4c3f-980b-3ede44f0edf2 tempest-VolumesTransfersV355Test-187805454 None] Created reservations ['e958c74c-adf9-4204-a682-5c96988ca692', '8db8f41d-3664-437e-95cc-f6145342dff1', 'ae483742-a091-4849-a4ff-9b243af10628', '4fdfb1f5-d1a7-4b8f-808f-130ec2264acd'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:18:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-17c81a44-1418-4c3f-980b-3ede44f0edf2 tempest-VolumesTransfersV355Test-187805454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-17c81a44-1418-4c3f-980b-3ede44f0edf2 tempest-VolumesTransfersV355Test-187805454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-17c81a44-1418-4c3f-980b-3ede44f0edf2 tempest-VolumesTransfersV355Test-187805454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-17c81a44-1418-4c3f-980b-3ede44f0edf2 tempest-VolumesTransfersV355Test-187805454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-17c81a44-1418-4c3f-980b-3ede44f0edf2 tempest-VolumesTransfersV355Test-187805454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-17c81a44-1418-4c3f-980b-3ede44f0edf2 tempest-VolumesTransfersV355Test-187805454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:12 devstack sudo[100657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:18:12 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:12 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] group_snapshot f0bcaa76-db2e-4aff-a5a3-8c5ca9c55be4: deleting
Sep 28 18:18:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] group_snapshot f0bcaa76-db2e-4aff-a5a3-8c5ca9c55be4: deleting {{(pid=87046) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 28 18:18:12 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] Acquiring lock "cinder-quobyte-71d24f2a-8117-4a8b-8b96-a4e4dc85928c" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:12 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] Lock "cinder-quobyte-71d24f2a-8117-4a8b-8b96-a4e4dc85928c" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:12 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] Acquiring lock "cinder-quobyte-99098593-d625-45e0-90cb-67c72b631053" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:12 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] Lock "cinder-quobyte-99098593-d625-45e0-90cb-67c72b631053" acquired by "_delete_snapshot" :: waited 0.067s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] Deleting offline snapshot 99098593-d625-45e0-90cb-67c72b631053 of volume 71d24f2a-8117-4a8b-8b96-a4e4dc85928c {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:18:12 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] snapshot_file for this snap is: volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.99098593-d625-45e0-90cb-67c72b631053 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:18:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-17c81a44-1418-4c3f-980b-3ede44f0edf2 tempest-VolumesTransfersV355Test-187805454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.592s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:12 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-17c81a44-1418-4c3f-980b-3ede44f0edf2 tempest-VolumesTransfersV355Test-187805454 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:18:12 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-17c81a44-1418-4c3f-980b-3ede44f0edf2 tempest-VolumesTransfersV355Test-187805454 None] Deleted volume successfully.
Sep 28 18:18:12 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fb2da6-4dd4-4409-85c1-aa13b5e92412]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.99098593-d625-45e0-90cb-67c72b631053 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:13 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-17c81a44-1418-4c3f-980b-3ede44f0edf2 tempest-VolumesTransfersV355Test-187805454 None] Lock "cinder-2c64bf53-7158-4cad-b9cb-75d7c4d1322f-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:13 devstack sudo[100661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.99098593-d625-45e0-90cb-67c72b631053
Sep 28 18:18:13 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:13 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.99098593-d625-45e0-90cb-67c72b631053" returned: 0 in 0.665s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:13 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:18:13 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2e82e7-1247-42b1-87e1-ba489e04b590]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:13 devstack sudo[100666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c
Sep 28 18:18:13 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Flow 'volume_create_manager' (5fd6690d-44c8-4646-9b6f-0d8ded7237b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2012f2fd-a1b5-4572-8ea2-93c8f509040c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2012f2fd-a1b5-4572-8ea2-93c8f509040c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1832301936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e4ab0b-1036-4ff9-a52c-6f0b00525c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f192e57e5ccb4868868b0b63d884c275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:14Z,use_quota=True,user_id='3849c96b303b42ff9b431d42df6549e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f35afc-38be-4594-9054-57d683a580c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f35afc-38be-4594-9054-57d683a580c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0791f6e3-d8b4-41d5-8f0a-bdbfe51eb044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0791f6e3-d8b4-41d5-8f0a-bdbfe51eb044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60e4ab0b-1036-4ff9-a52c-6f0b00525c02', 'volume_name': 'volume-60e4ab0b-1036-4ff9-a52c-6f0b00525c02', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a606e5-1e3f-4c25-9234-bdc2cf12c232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a606e5-1e3f-4c25-9234-bdc2cf12c232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192ff1f3-2aae-47a6-bb99-fe6142235604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:14 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Volume 60e4ab0b-1036-4ff9-a52c-6f0b00525c02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60e4ab0b-1036-4ff9-a52c-6f0b00525c02', 'volume_size': 1}
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1832301936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e4ab0b-1036-4ff9-a52c-6f0b00525c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f192e57e5ccb4868868b0b63d884c275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:14Z,use_quota=True,user_id='3849c96b303b42ff9b431d42df6549e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Creating volume 60e4ab0b-1036-4ff9-a52c-6f0b00525c02 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:18:14 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-60e4ab0b-1036-4ff9-a52c-6f0b00525c02 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:14 devstack sudo[100670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-60e4ab0b-1036-4ff9-a52c-6f0b00525c02 1073741824
Sep 28 18:18:14 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:14 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c" returned: 0 in 0.680s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.99098593-d625-45e0-90cb-67c72b631053 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:14 devstack sudo[100675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.99098593-d625-45e0-90cb-67c72b631053
Sep 28 18:18:14 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:14 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-60e4ab0b-1036-4ff9-a52c-6f0b00525c02 1073741824" returned: 0 in 0.703s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:14 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.99098593-d625-45e0-90cb-67c72b631053" returned: 0 in 0.639s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.99098593-d625-45e0-90cb-67c72b631053 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-60e4ab0b-1036-4ff9-a52c-6f0b00525c02 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:15 devstack sudo[100684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.99098593-d625-45e0-90cb-67c72b631053
Sep 28 18:18:15 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:15 devstack sudo[100685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-60e4ab0b-1036-4ff9-a52c-6f0b00525c02
Sep 28 18:18:15 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:15 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c.99098593-d625-45e0-90cb-67c72b631053" returned: 0 in 0.347s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:15 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-60e4ab0b-1036-4ff9-a52c-6f0b00525c02" returned: 0 in 0.367s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:18:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:15 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] Lock "cinder-quobyte-99098593-d625-45e0-90cb-67c72b631053" released by "_delete_snapshot" :: held 2.615s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:15 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] Lock "cinder-quobyte-71d24f2a-8117-4a8b-8b96-a4e4dc85928c" released by "delete_snapshot" :: held 2.697s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192ff1f3-2aae-47a6-bb99-fe6142235604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60e4ab0b-1036-4ff9-a52c-6f0b00525c02', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed3067a-5b46-404b-b0e7-c3f50ba4f7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:15 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Volume volume-60e4ab0b-1036-4ff9-a52c-6f0b00525c02 (60e4ab0b-1036-4ff9-a52c-6f0b00525c02): created successfully
Sep 28 18:18:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed3067a-5b46-404b-b0e7-c3f50ba4f7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Flow 'volume_create_manager' (5fd6690d-44c8-4646-9b6f-0d8ded7237b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:15 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-e3dd3a46-c937-4dd5-8dc1-2600a61424f7 tempest-VolumesTransfersV355Test-531812068 None] Created volume successfully.
Sep 28 18:18:15 devstack cinder-volume[87046]: WARNING cinder.quota [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-442900427 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-442900427, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:18:15 devstack cinder-volume[87046]: WARNING cinder.quota [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-442900427 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-442900427, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:18:15 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] Created reservations ['46f482b0-b5a6-48a9-aa3b-834a0bf6b166', '1fcbbe25-b902-4f22-ada9-c622c5c2f070', 'c5e94782-f1e3-4ca3-a43e-b16b2f3464d7', '0154d34a-9aa1-4def-8bb3-7e0c1d2ecb2d'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:18:15 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-1181f126-521f-4c34-ae04-37d182735943 tempest-GroupSnapshotsV319Test-1588090796 None] group_snapshot f0bcaa76-db2e-4aff-a5a3-8c5ca9c55be4: deleted successfully
Sep 28 18:18:16 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-18ad3f23-36a2-483c-babe-38de021ede33 tempest-VolumesTransfersV355Test-187805454 None] Acquiring lock "cinder-60e4ab0b-1036-4ff9-a52c-6f0b00525c02-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:16 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-18ad3f23-36a2-483c-babe-38de021ede33 tempest-VolumesTransfersV355Test-187805454 None] Lock "cinder-60e4ab0b-1036-4ff9-a52c-6f0b00525c02-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:16 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-43e6569e-19f3-42ce-b3e6-7ce77c9a32e3 tempest-GroupSnapshotsV319Test-1588090796 None] Acquiring lock "cinder-quobyte-71d24f2a-8117-4a8b-8b96-a4e4dc85928c" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:16 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-18ad3f23-36a2-483c-babe-38de021ede33 tempest-VolumesTransfersV355Test-187805454 None] Acquiring lock "cinder-quobyte-60e4ab0b-1036-4ff9-a52c-6f0b00525c02" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:16 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-43e6569e-19f3-42ce-b3e6-7ce77c9a32e3 tempest-GroupSnapshotsV319Test-1588090796 None] Lock "cinder-quobyte-71d24f2a-8117-4a8b-8b96-a4e4dc85928c" acquired by "delete_volume" :: waited 0.030s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:16 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-18ad3f23-36a2-483c-babe-38de021ede33 tempest-VolumesTransfersV355Test-187805454 None] Lock "cinder-quobyte-60e4ab0b-1036-4ff9-a52c-6f0b00525c02" acquired by "delete_volume" :: waited 0.090s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:17 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[72af5b8a-d5cb-489c-b036-08f23bd3a647]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-43e6569e-19f3-42ce-b3e6-7ce77c9a32e3 tempest-GroupSnapshotsV319Test-1588090796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:17 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b2a1e2-2d09-487a-85a5-5453aec7c2c5]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18ad3f23-36a2-483c-babe-38de021ede33 tempest-VolumesTransfersV355Test-187805454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-60e4ab0b-1036-4ff9-a52c-6f0b00525c02 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:17 devstack sudo[100690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c
Sep 28 18:18:17 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:17 devstack sudo[100691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-60e4ab0b-1036-4ff9-a52c-6f0b00525c02
Sep 28 18:18:17 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:17 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18ad3f23-36a2-483c-babe-38de021ede33 tempest-VolumesTransfersV355Test-187805454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-60e4ab0b-1036-4ff9-a52c-6f0b00525c02" returned: 0 in 0.674s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:17 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18ad3f23-36a2-483c-babe-38de021ede33 tempest-VolumesTransfersV355Test-187805454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-60e4ab0b-1036-4ff9-a52c-6f0b00525c02 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-43e6569e-19f3-42ce-b3e6-7ce77c9a32e3 tempest-GroupSnapshotsV319Test-1588090796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c" returned: 0 in 0.727s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-43e6569e-19f3-42ce-b3e6-7ce77c9a32e3 tempest-GroupSnapshotsV319Test-1588090796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:17 devstack sudo[100701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-60e4ab0b-1036-4ff9-a52c-6f0b00525c02
Sep 28 18:18:17 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:17 devstack sudo[100702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c
Sep 28 18:18:17 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:18 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-43e6569e-19f3-42ce-b3e6-7ce77c9a32e3 tempest-GroupSnapshotsV319Test-1588090796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-71d24f2a-8117-4a8b-8b96-a4e4dc85928c" returned: 0 in 0.564s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:18 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-43e6569e-19f3-42ce-b3e6-7ce77c9a32e3 tempest-GroupSnapshotsV319Test-1588090796 None] Lock "cinder-quobyte-71d24f2a-8117-4a8b-8b96-a4e4dc85928c" released by "delete_volume" :: held 1.459s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:18 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18ad3f23-36a2-483c-babe-38de021ede33 tempest-VolumesTransfersV355Test-187805454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-60e4ab0b-1036-4ff9-a52c-6f0b00525c02" returned: 0 in 0.665s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:18 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-18ad3f23-36a2-483c-babe-38de021ede33 tempest-VolumesTransfersV355Test-187805454 None] Lock "cinder-quobyte-60e4ab0b-1036-4ff9-a52c-6f0b00525c02" released by "delete_volume" :: held 1.440s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:18 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-18ad3f23-36a2-483c-babe-38de021ede33 tempest-VolumesTransfersV355Test-187805454 None] Created reservations ['ffe4894d-a414-4bc9-944c-1991e3d93f20', '94a16889-ea40-49ce-9684-0a7a633766f5', 'e451f635-100e-45ca-8374-ac40d6453827', '813553fa-b03d-40ea-90e2-222097d17eee'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:18:18 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-43e6569e-19f3-42ce-b3e6-7ce77c9a32e3 tempest-GroupSnapshotsV319Test-1588090796 None] Created reservations ['e463db8a-4b05-4744-82a1-1495ce9f1ea5'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:18:18 devstack cinder-volume[87046]: WARNING cinder.quota [None req-43e6569e-19f3-42ce-b3e6-7ce77c9a32e3 tempest-GroupSnapshotsV319Test-1588090796 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-442900427 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-442900427, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:18:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-18ad3f23-36a2-483c-babe-38de021ede33 tempest-VolumesTransfersV355Test-187805454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-18ad3f23-36a2-483c-babe-38de021ede33 tempest-VolumesTransfersV355Test-187805454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:18 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-18ad3f23-36a2-483c-babe-38de021ede33 tempest-VolumesTransfersV355Test-187805454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:18 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-18ad3f23-36a2-483c-babe-38de021ede33 tempest-VolumesTransfersV355Test-187805454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-18ad3f23-36a2-483c-babe-38de021ede33 tempest-VolumesTransfersV355Test-187805454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18ad3f23-36a2-483c-babe-38de021ede33 tempest-VolumesTransfersV355Test-187805454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:18 devstack sudo[100707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:18:18 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:18 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-43e6569e-19f3-42ce-b3e6-7ce77c9a32e3 tempest-GroupSnapshotsV319Test-1588090796 None] Created reservations ['38c0b381-9067-431b-9056-cab18424ce7b', '86e094d4-fd43-4d08-8b69-5e4a2a2c7455', 'b9dfeab0-6eb9-4165-8d9f-fc53c1d619aa', '54b4d761-2517-42b2-afb0-9428902c4d53'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:18:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-43e6569e-19f3-42ce-b3e6-7ce77c9a32e3 tempest-GroupSnapshotsV319Test-1588090796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-43e6569e-19f3-42ce-b3e6-7ce77c9a32e3 tempest-GroupSnapshotsV319Test-1588090796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:19 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-43e6569e-19f3-42ce-b3e6-7ce77c9a32e3 tempest-GroupSnapshotsV319Test-1588090796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:19 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-43e6569e-19f3-42ce-b3e6-7ce77c9a32e3 tempest-GroupSnapshotsV319Test-1588090796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-43e6569e-19f3-42ce-b3e6-7ce77c9a32e3 tempest-GroupSnapshotsV319Test-1588090796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-43e6569e-19f3-42ce-b3e6-7ce77c9a32e3 tempest-GroupSnapshotsV319Test-1588090796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:19 devstack sudo[100710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:18:19 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:19 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-18ad3f23-36a2-483c-babe-38de021ede33 tempest-VolumesTransfersV355Test-187805454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.486s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:19 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-18ad3f23-36a2-483c-babe-38de021ede33 tempest-VolumesTransfersV355Test-187805454 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:18:19 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-18ad3f23-36a2-483c-babe-38de021ede33 tempest-VolumesTransfersV355Test-187805454 None] Deleted volume successfully.
Sep 28 18:18:19 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-18ad3f23-36a2-483c-babe-38de021ede33 tempest-VolumesTransfersV355Test-187805454 None] Lock "cinder-60e4ab0b-1036-4ff9-a52c-6f0b00525c02-delete_volume" released by "delete_volume" :: held 2.495s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:19 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-43e6569e-19f3-42ce-b3e6-7ce77c9a32e3 tempest-GroupSnapshotsV319Test-1588090796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.538s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:19 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-43e6569e-19f3-42ce-b3e6-7ce77c9a32e3 tempest-GroupSnapshotsV319Test-1588090796 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:18:19 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-43e6569e-19f3-42ce-b3e6-7ce77c9a32e3 tempest-GroupSnapshotsV319Test-1588090796 None] Delete group completed successfully.
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Flow 'volume_create_manager' (78171e49-03dc-48e4-b212-fc9aefb89075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c404b88-a29e-4752-b130-c8b3923227c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c404b88-a29e-4752-b130-c8b3923227c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1020352772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9ccb31-f05e-4edc-839e-2f9eca29bac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb814caf14fb47fb86b94c2f371fe0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:20Z,use_quota=True,user_id='e15d97b924a346b4b335510f51ccb3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b561cf-ef87-49fe-823a-ba36af095f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b561cf-ef87-49fe-823a-ba36af095f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace1fda7-a074-4d7e-8798-f778da8a1f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace1fda7-a074-4d7e-8798-f778da8a1f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af9ccb31-f05e-4edc-839e-2f9eca29bac7', 'volume_name': 'volume-af9ccb31-f05e-4edc-839e-2f9eca29bac7', 'volume_size': 2}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c112e709-6e98-487b-a99d-076ca546b500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c112e709-6e98-487b-a99d-076ca546b500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de913cd-a5d2-4e36-afc2-95507398a00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:20 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Volume af9ccb31-f05e-4edc-839e-2f9eca29bac7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af9ccb31-f05e-4edc-839e-2f9eca29bac7', 'volume_size': 2}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1020352772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9ccb31-f05e-4edc-839e-2f9eca29bac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb814caf14fb47fb86b94c2f371fe0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:20Z,use_quota=True,user_id='e15d97b924a346b4b335510f51ccb3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Creating volume af9ccb31-f05e-4edc-839e-2f9eca29bac7 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:18:20 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af9ccb31-f05e-4edc-839e-2f9eca29bac7 2147483648 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:18:20 devstack sudo[100714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af9ccb31-f05e-4edc-839e-2f9eca29bac7 2147483648
Sep 28 18:18:20 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Flow 'volume_create_manager' (c3c5a03a-9e96-47cb-aaf8-5ca6031f200c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898e0127-1f27-4d75-9cfb-fd1fe894da56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898e0127-1f27-4d75-9cfb-fd1fe894da56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1262107540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f40e455-a06d-4163-8b7e-abed4bb69114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce67861aca4540cfb9be7054c2917b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:20Z,use_quota=True,user_id='babd04cf4f0f45da9bd78af2f0f7e1ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01675541-77de-4ba3-8d85-81207d7ba133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01675541-77de-4ba3-8d85-81207d7ba133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3321b934-a313-408a-bd5f-49c59c5ece6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3321b934-a313-408a-bd5f-49c59c5ece6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f40e455-a06d-4163-8b7e-abed4bb69114', 'volume_name': 'volume-6f40e455-a06d-4163-8b7e-abed4bb69114', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdbf63fe-250d-4d3c-8638-c51494761142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdbf63fe-250d-4d3c-8638-c51494761142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8a5ae9-dcac-41bf-bcb6-5efc9d48e741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:20 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Volume 6f40e455-a06d-4163-8b7e-abed4bb69114: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f40e455-a06d-4163-8b7e-abed4bb69114', 'volume_size': 1}
Sep 28 18:18:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:21 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af9ccb31-f05e-4edc-839e-2f9eca29bac7 2147483648" returned: 0 in 0.773s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af9ccb31-f05e-4edc-839e-2f9eca29bac7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:21 devstack sudo[100722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af9ccb31-f05e-4edc-839e-2f9eca29bac7
Sep 28 18:18:21 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:21 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af9ccb31-f05e-4edc-839e-2f9eca29bac7" returned: 0 in 0.292s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:18:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.944s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1262107540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f40e455-a06d-4163-8b7e-abed4bb69114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce67861aca4540cfb9be7054c2917b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:20Z,use_quota=True,user_id='babd04cf4f0f45da9bd78af2f0f7e1ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:18:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Creating volume 6f40e455-a06d-4163-8b7e-abed4bb69114 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:18:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:18:21 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:18:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de913cd-a5d2-4e36-afc2-95507398a00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af9ccb31-f05e-4edc-839e-2f9eca29bac7', 'volume_size': 2}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:21 devstack sudo[100725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114 1073741824
Sep 28 18:18:21 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4481e6bc-b8a5-4c0d-9446-86ca76a4f92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:21 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Volume volume-af9ccb31-f05e-4edc-839e-2f9eca29bac7 (af9ccb31-f05e-4edc-839e-2f9eca29bac7): created successfully
Sep 28 18:18:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4481e6bc-b8a5-4c0d-9446-86ca76a4f92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Flow 'volume_create_manager' (78171e49-03dc-48e4-b212-fc9aefb89075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:21 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-f6ff80a9-3f45-46df-970d-1d0fba915801 tempest-VolumesCloneNegativeTest-291529600 None] Created volume successfully.
Sep 28 18:18:22 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114 1073741824" returned: 0 in 0.675s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:22 devstack sudo[100731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114
Sep 28 18:18:22 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9d20ab92-6e28-4a66-80e6-edb55795749a tempest-VolumesCloneNegativeTest-291529600 None] Acquiring lock "cinder-af9ccb31-f05e-4edc-839e-2f9eca29bac7-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9d20ab92-6e28-4a66-80e6-edb55795749a tempest-VolumesCloneNegativeTest-291529600 None] Lock "cinder-af9ccb31-f05e-4edc-839e-2f9eca29bac7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9d20ab92-6e28-4a66-80e6-edb55795749a tempest-VolumesCloneNegativeTest-291529600 None] Acquiring lock "cinder-quobyte-af9ccb31-f05e-4edc-839e-2f9eca29bac7" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9d20ab92-6e28-4a66-80e6-edb55795749a tempest-VolumesCloneNegativeTest-291529600 None] Lock "cinder-quobyte-af9ccb31-f05e-4edc-839e-2f9eca29bac7" acquired by "delete_volume" :: waited 0.029s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:22 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90ccd87-41ab-4fc5-b34c-9c7a1a0e5429]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d20ab92-6e28-4a66-80e6-edb55795749a tempest-VolumesCloneNegativeTest-291529600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af9ccb31-f05e-4edc-839e-2f9eca29bac7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:22 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114" returned: 0 in 0.531s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:22 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:18:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8a5ae9-dcac-41bf-bcb6-5efc9d48e741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f40e455-a06d-4163-8b7e-abed4bb69114', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f41d3f-f242-43e1-abfc-93935bb99301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:22 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Volume volume-6f40e455-a06d-4163-8b7e-abed4bb69114 (6f40e455-a06d-4163-8b7e-abed4bb69114): created successfully
Sep 28 18:18:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f41d3f-f242-43e1-abfc-93935bb99301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Flow 'volume_create_manager' (c3c5a03a-9e96-47cb-aaf8-5ca6031f200c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:22 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-60d80617-6ee3-4d10-8958-4a3ec5c8cfbc tempest-SnapshotDependencyTests-582505932 None] Created volume successfully.
Sep 28 18:18:22 devstack sudo[100734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af9ccb31-f05e-4edc-839e-2f9eca29bac7
Sep 28 18:18:22 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:23 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d20ab92-6e28-4a66-80e6-edb55795749a tempest-VolumesCloneNegativeTest-291529600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af9ccb31-f05e-4edc-839e-2f9eca29bac7" returned: 0 in 0.588s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d20ab92-6e28-4a66-80e6-edb55795749a tempest-VolumesCloneNegativeTest-291529600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af9ccb31-f05e-4edc-839e-2f9eca29bac7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:23 devstack sudo[100742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af9ccb31-f05e-4edc-839e-2f9eca29bac7
Sep 28 18:18:23 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:23 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d20ab92-6e28-4a66-80e6-edb55795749a tempest-VolumesCloneNegativeTest-291529600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af9ccb31-f05e-4edc-839e-2f9eca29bac7" returned: 0 in 0.394s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9d20ab92-6e28-4a66-80e6-edb55795749a tempest-VolumesCloneNegativeTest-291529600 None] Lock "cinder-quobyte-af9ccb31-f05e-4edc-839e-2f9eca29bac7" released by "delete_volume" :: held 1.074s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:23 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-9d20ab92-6e28-4a66-80e6-edb55795749a tempest-VolumesCloneNegativeTest-291529600 None] Created reservations ['54bd60c7-678f-4027-a61d-e932a9fd2c48', 'acb792c9-f434-4e25-880b-404455665551', 'b9cc4d8e-61ea-41d9-af56-d2fa3a24009a', '4edc3c54-561b-46b5-8e71-c2a014f7f1b7'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:18:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-909d344f-b5e0-4b9b-85d2-c258b27e19fd tempest-SnapshotDependencyTests-582505932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-909d344f-b5e0-4b9b-85d2-c258b27e19fd tempest-SnapshotDependencyTests-582505932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:23 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-909d344f-b5e0-4b9b-85d2-c258b27e19fd tempest-SnapshotDependencyTests-582505932 None] Creating offline snapshot 41501b4d-98e4-45b6-8140-0d2db9d14629 of volume 6f40e455-a06d-4163-8b7e-abed4bb69114 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:18:23 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a96760-2eee-454e-9252-ed5f28d4e9c5]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-909d344f-b5e0-4b9b-85d2-c258b27e19fd tempest-SnapshotDependencyTests-582505932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9d20ab92-6e28-4a66-80e6-edb55795749a tempest-VolumesCloneNegativeTest-291529600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9d20ab92-6e28-4a66-80e6-edb55795749a tempest-VolumesCloneNegativeTest-291529600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9d20ab92-6e28-4a66-80e6-edb55795749a tempest-VolumesCloneNegativeTest-291529600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9d20ab92-6e28-4a66-80e6-edb55795749a tempest-VolumesCloneNegativeTest-291529600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9d20ab92-6e28-4a66-80e6-edb55795749a tempest-VolumesCloneNegativeTest-291529600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d20ab92-6e28-4a66-80e6-edb55795749a tempest-VolumesCloneNegativeTest-291529600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:24 devstack sudo[100746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:18:24 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:24 devstack sudo[100745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114
Sep 28 18:18:24 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:24 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d20ab92-6e28-4a66-80e6-edb55795749a tempest-VolumesCloneNegativeTest-291529600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.429s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:24 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-9d20ab92-6e28-4a66-80e6-edb55795749a tempest-VolumesCloneNegativeTest-291529600 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:18:24 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-9d20ab92-6e28-4a66-80e6-edb55795749a tempest-VolumesCloneNegativeTest-291529600 None] Deleted volume successfully.
Sep 28 18:18:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9d20ab92-6e28-4a66-80e6-edb55795749a tempest-VolumesCloneNegativeTest-291529600 None] Lock "cinder-af9ccb31-f05e-4edc-839e-2f9eca29bac7-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:24 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-909d344f-b5e0-4b9b-85d2-c258b27e19fd tempest-SnapshotDependencyTests-582505932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114" returned: 0 in 0.613s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-909d344f-b5e0-4b9b-85d2-c258b27e19fd tempest-SnapshotDependencyTests-582505932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:24 devstack sudo[100753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629 1G
Sep 28 18:18:24 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:25 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-909d344f-b5e0-4b9b-85d2-c258b27e19fd tempest-SnapshotDependencyTests-582505932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629 1G" returned: 0 in 0.723s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-909d344f-b5e0-4b9b-85d2-c258b27e19fd tempest-SnapshotDependencyTests-582505932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f40e455-a06d-4163-8b7e-abed4bb69114 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:25 devstack sudo[100759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f40e455-a06d-4163-8b7e-abed4bb69114 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629
Sep 28 18:18:25 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:25 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-909d344f-b5e0-4b9b-85d2-c258b27e19fd tempest-SnapshotDependencyTests-582505932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f40e455-a06d-4163-8b7e-abed4bb69114 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629" returned: 0 in 0.475s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:25 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-909d344f-b5e0-4b9b-85d2-c258b27e19fd tempest-SnapshotDependencyTests-582505932 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629 is being set with open permissions: ugo+rw
Sep 28 18:18:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-909d344f-b5e0-4b9b-85d2-c258b27e19fd tempest-SnapshotDependencyTests-582505932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:25 devstack sudo[100765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629
Sep 28 18:18:25 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:26 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-909d344f-b5e0-4b9b-85d2-c258b27e19fd tempest-SnapshotDependencyTests-582505932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629" returned: 0 in 0.431s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-909d344f-b5e0-4b9b-85d2-c258b27e19fd tempest-SnapshotDependencyTests-582505932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:26 devstack sudo[100768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.info
Sep 28 18:18:26 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:26 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-909d344f-b5e0-4b9b-85d2-c258b27e19fd tempest-SnapshotDependencyTests-582505932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.info" returned: 0 in 0.438s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:26 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-909d344f-b5e0-4b9b-85d2-c258b27e19fd tempest-SnapshotDependencyTests-582505932 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.info is being set with open permissions: ugo+rw
Sep 28 18:18:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-909d344f-b5e0-4b9b-85d2-c258b27e19fd tempest-SnapshotDependencyTests-582505932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:26 devstack sudo[100771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.info
Sep 28 18:18:26 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:27 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-909d344f-b5e0-4b9b-85d2-c258b27e19fd tempest-SnapshotDependencyTests-582505932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.info" returned: 0 in 0.341s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-909d344f-b5e0-4b9b-85d2-c258b27e19fd tempest-SnapshotDependencyTests-582505932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.192s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:27 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-909d344f-b5e0-4b9b-85d2-c258b27e19fd tempest-SnapshotDependencyTests-582505932 None] Create snapshot completed successfully
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Flow 'volume_create_manager' (454c0511-2dbb-4160-b593-44a987642dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cdde00d-5ad9-4908-ba8a-c65a361b583c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cdde00d-5ad9-4908-ba8a-c65a361b583c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9756aaa7-da30-4ca1-9aae-53436f2ca897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce67861aca4540cfb9be7054c2917b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=41501b4d-98e4-45b6-8140-0d2db9d14629,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:29Z,use_quota=True,user_id='babd04cf4f0f45da9bd78af2f0f7e1ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e3211e-b665-407e-9612-d921e05c34b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e3211e-b665-407e-9612-d921e05c34b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1845c2-ccc4-4d5c-8169-e9835b10ca1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1845c2-ccc4-4d5c-8169-e9835b10ca1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9756aaa7-da30-4ca1-9aae-53436f2ca897', 'volume_name': 'volume-9756aaa7-da30-4ca1-9aae-53436f2ca897', 'volume_size': 1, 'snapshot_id': '41501b4d-98e4-45b6-8140-0d2db9d14629'}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e13f71-b541-455b-a8e1-96b40825973b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e13f71-b541-455b-a8e1-96b40825973b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (404fe23f-38fe-41c1-9492-c041937bd204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:29 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Volume 9756aaa7-da30-4ca1-9aae-53436f2ca897: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9756aaa7-da30-4ca1-9aae-53436f2ca897', 'volume_size': 1, 'snapshot_id': '41501b4d-98e4-45b6-8140-0d2db9d14629'}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Acquiring lock "cinder-quobyte-41501b4d-98e4-45b6-8140-0d2db9d14629-9756aaa7-da30-4ca1-9aae-53436f2ca897" by "_create_volume_from_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Lock "cinder-quobyte-41501b4d-98e4-45b6-8140-0d2db9d14629-9756aaa7-da30-4ca1-9aae-53436f2ca897" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Creating volume 9756aaa7-da30-4ca1-9aae-53436f2ca897 from snapshot 41501b4d-98e4-45b6-8140-0d2db9d14629 {{(pid=87046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Acquiring lock "cinder-quobyte-9756aaa7-da30-4ca1-9aae-53436f2ca897" by "_copy_volume_from_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Lock "cinder-quobyte-9756aaa7-da30-4ca1-9aae-53436f2ca897" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] snapshot: 41501b4d-98e4-45b6-8140-0d2db9d14629, volume: 9756aaa7-da30-4ca1-9aae-53436f2ca897,  {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7cb613-3f15-4012-b0f0-1632362af293]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:29 devstack sudo[100810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629
Sep 28 18:18:29 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:29 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629" returned: 0 in 0.474s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f40e455-a06d-4163-8b7e-abed4bb69114(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e774b25-d990-48d6-b804-c57bc4113fe0]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:29 devstack sudo[100815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114
Sep 28 18:18:29 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:30 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114" returned: 0 in 0.558s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114 {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 28 18:18:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Creating direct copy from snapshot {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 28 18:18:30 devstack cinder-volume[87046]: DEBUG cinder.utils [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Path /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9756aaa7-da30-4ca1-9aae-53436f2ca897 not found in is_blk_device check {{(pid=87046) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 28 18:18:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9756aaa7-da30-4ca1-9aae-53436f2ca897 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:30 devstack sudo[100820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9756aaa7-da30-4ca1-9aae-53436f2ca897
Sep 28 18:18:30 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:31 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:18:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Flow 'volume_create_manager' (6b328592-de22-4258-b780-e7aac750d298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98476b2e-c686-49bf-9ba0-7fa36a04b48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98476b2e-c686-49bf-9ba0-7fa36a04b48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1623551194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdd47450-ff44-4f28-be6c-23b2a04cc8e4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94b02642c5af4545836c283fc55b2409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:32Z,use_quota=True,user_id='825254fe29324576a8a7855a200e4b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf4da22-7368-406f-b348-b7fe26cab7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf4da22-7368-406f-b348-b7fe26cab7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ef2864-c244-4e2b-aebd-b5aa36eaaa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ef2864-c244-4e2b-aebd-b5aa36eaaa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdd47450-ff44-4f28-be6c-23b2a04cc8e4', 'volume_name': 'volume-cdd47450-ff44-4f28-be6c-23b2a04cc8e4', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40748525-2679-479c-9147-4eaadd4d89a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40748525-2679-479c-9147-4eaadd4d89a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ad9af5-7628-4ace-8baf-01fbc42ebe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:32 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Volume cdd47450-ff44-4f28-be6c-23b2a04cc8e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdd47450-ff44-4f28-be6c-23b2a04cc8e4', 'volume_size': 1}
Sep 28 18:18:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:39 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:UPDATE=79,cinder:SELECT=74,cinder:DELETE=5,cinder:INSERT=14 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:18:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:18:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:39 devstack sudo[100834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:18:39 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:40 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.697s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:18:40 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9756aaa7-da30-4ca1-9aae-53436f2ca897" returned: 0 in 9.816s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Image conversion details: src /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114, size 1024.00 MB, duration 9.82 sec, destination /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9756aaa7-da30-4ca1-9aae-53436f2ca897 {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:18:40 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Converted 1024.00 MB image at 104.30 MB/s
Sep 28 18:18:40 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9756aaa7-da30-4ca1-9aae-53436f2ca897 is being set with open permissions: ugo+rw
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9756aaa7-da30-4ca1-9aae-53436f2ca897 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:40 devstack sudo[100837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9756aaa7-da30-4ca1-9aae-53436f2ca897
Sep 28 18:18:40 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:40 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9756aaa7-da30-4ca1-9aae-53436f2ca897" returned: 0 in 0.363s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Lock "cinder-quobyte-9756aaa7-da30-4ca1-9aae-53436f2ca897" released by "_copy_volume_from_snapshot" :: held 11.337s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Lock "cinder-quobyte-41501b4d-98e4-45b6-8140-0d2db9d14629-9756aaa7-da30-4ca1-9aae-53436f2ca897" released by "_create_volume_from_snapshot" :: held 11.429s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.452s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.415s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1623551194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdd47450-ff44-4f28-be6c-23b2a04cc8e4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94b02642c5af4545836c283fc55b2409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:32Z,use_quota=True,user_id='825254fe29324576a8a7855a200e4b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Creating volume cdd47450-ff44-4f28-be6c-23b2a04cc8e4 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:18:40 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cdd47450-ff44-4f28-be6c-23b2a04cc8e4 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:40 devstack sudo[100840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cdd47450-ff44-4f28-be6c-23b2a04cc8e4 1073741824
Sep 28 18:18:40 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (404fe23f-38fe-41c1-9492-c041937bd204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9756aaa7-da30-4ca1-9aae-53436f2ca897', 'volume_size': 1, 'snapshot_id': '41501b4d-98e4-45b6-8140-0d2db9d14629'}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e533eaa4-674a-4f3a-9a82-36bb21db1c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:40 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Volume volume-9756aaa7-da30-4ca1-9aae-53436f2ca897 (9756aaa7-da30-4ca1-9aae-53436f2ca897): created successfully
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e533eaa4-674a-4f3a-9a82-36bb21db1c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Flow 'volume_create_manager' (454c0511-2dbb-4160-b593-44a987642dd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:40 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-5ec4b3ba-4376-4ded-979b-bc4ccf5103bc tempest-SnapshotDependencyTests-582505932 None] Created volume successfully.
Sep 28 18:18:41 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cdd47450-ff44-4f28-be6c-23b2a04cc8e4 1073741824" returned: 0 in 0.694s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cdd47450-ff44-4f28-be6c-23b2a04cc8e4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:41 devstack sudo[100845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cdd47450-ff44-4f28-be6c-23b2a04cc8e4
Sep 28 18:18:41 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-834d1b74-1b90-476b-814c-2268a688590c tempest-SnapshotDependencyTests-582505932 None] Acquiring lock "cinder-41501b4d-98e4-45b6-8140-0d2db9d14629-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-834d1b74-1b90-476b-814c-2268a688590c tempest-SnapshotDependencyTests-582505932 None] Lock "cinder-41501b4d-98e4-45b6-8140-0d2db9d14629-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-834d1b74-1b90-476b-814c-2268a688590c tempest-SnapshotDependencyTests-582505932 None] Acquiring lock "cinder-quobyte-6f40e455-a06d-4163-8b7e-abed4bb69114" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-834d1b74-1b90-476b-814c-2268a688590c tempest-SnapshotDependencyTests-582505932 None] Lock "cinder-quobyte-6f40e455-a06d-4163-8b7e-abed4bb69114" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-834d1b74-1b90-476b-814c-2268a688590c tempest-SnapshotDependencyTests-582505932 None] Acquiring lock "cinder-quobyte-41501b4d-98e4-45b6-8140-0d2db9d14629" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-834d1b74-1b90-476b-814c-2268a688590c tempest-SnapshotDependencyTests-582505932 None] Lock "cinder-quobyte-41501b4d-98e4-45b6-8140-0d2db9d14629" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-834d1b74-1b90-476b-814c-2268a688590c tempest-SnapshotDependencyTests-582505932 None] Deleting offline snapshot 41501b4d-98e4-45b6-8140-0d2db9d14629 of volume 6f40e455-a06d-4163-8b7e-abed4bb69114 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:18:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-834d1b74-1b90-476b-814c-2268a688590c tempest-SnapshotDependencyTests-582505932 None] snapshot_file for this snap is: volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:18:41 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8e8c19-a7a6-49d5-9ab1-e0a206fb964d]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-834d1b74-1b90-476b-814c-2268a688590c tempest-SnapshotDependencyTests-582505932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:41 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cdd47450-ff44-4f28-be6c-23b2a04cc8e4" returned: 0 in 0.388s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:18:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ad9af5-7628-4ace-8baf-01fbc42ebe65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdd47450-ff44-4f28-be6c-23b2a04cc8e4', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea328074-57b6-42e6-8afc-124de362604b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:41 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Volume volume-cdd47450-ff44-4f28-be6c-23b2a04cc8e4 (cdd47450-ff44-4f28-be6c-23b2a04cc8e4): created successfully
Sep 28 18:18:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea328074-57b6-42e6-8afc-124de362604b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Flow 'volume_create_manager' (6b328592-de22-4258-b780-e7aac750d298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:41 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-472c0471-353f-409c-b617-a3a20d60aae9 tempest-VolumesGetTest-374048226 None] Created volume successfully.
Sep 28 18:18:41 devstack sudo[100848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629
Sep 28 18:18:41 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:42 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-834d1b74-1b90-476b-814c-2268a688590c tempest-SnapshotDependencyTests-582505932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629" returned: 0 in 0.766s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-834d1b74-1b90-476b-814c-2268a688590c tempest-SnapshotDependencyTests-582505932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f40e455-a06d-4163-8b7e-abed4bb69114(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:18:42 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea406ab-b972-4a5d-b24a-17bc4b253ce0]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-834d1b74-1b90-476b-814c-2268a688590c tempest-SnapshotDependencyTests-582505932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:42 devstack sudo[100853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114
Sep 28 18:18:42 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:43 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-834d1b74-1b90-476b-814c-2268a688590c tempest-SnapshotDependencyTests-582505932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114" returned: 0 in 0.874s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-834d1b74-1b90-476b-814c-2268a688590c tempest-SnapshotDependencyTests-582505932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:43 devstack sudo[100860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629
Sep 28 18:18:43 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Flow 'volume_create_manager' (4930bef7-8a2e-40b9-a2d0-98858b9d0e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906d3cfc-d5cd-4ff7-847a-2df7b3fc7eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906d3cfc-d5cd-4ff7-847a-2df7b3fc7eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:18:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-558530279',display_name='tempest-VolumesGetTest-Volume-1933283249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022c8871-62ab-499d-86d4-5f0fac7c8f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b02642c5af4545836c283fc55b2409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:44Z,use_quota=True,user_id='825254fe29324576a8a7855a200e4b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe78194d-555e-4706-99cd-add15baf5ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe78194d-555e-4706-99cd-add15baf5ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b4fa76-6184-4a80-a798-6820f6fc5dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b4fa76-6184-4a80-a798-6820f6fc5dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '022c8871-62ab-499d-86d4-5f0fac7c8f8e', 'volume_name': 'volume-022c8871-62ab-499d-86d4-5f0fac7c8f8e', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:44 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b522c5-b46e-4ef6-b454-f67909ccfba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b522c5-b46e-4ef6-b454-f67909ccfba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73cace47-65b1-43d4-85c7-f505a0154c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:44 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Volume 022c8871-62ab-499d-86d4-5f0fac7c8f8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-022c8871-62ab-499d-86d4-5f0fac7c8f8e', 'volume_size': 1}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:18:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-558530279',display_name='tempest-VolumesGetTest-Volume-1933283249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022c8871-62ab-499d-86d4-5f0fac7c8f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b02642c5af4545836c283fc55b2409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:44Z,use_quota=True,user_id='825254fe29324576a8a7855a200e4b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Creating volume 022c8871-62ab-499d-86d4-5f0fac7c8f8e {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:18:44 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-022c8871-62ab-499d-86d4-5f0fac7c8f8e 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-834d1b74-1b90-476b-814c-2268a688590c tempest-SnapshotDependencyTests-582505932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629" returned: 0 in 0.738s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-834d1b74-1b90-476b-814c-2268a688590c tempest-SnapshotDependencyTests-582505932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:44 devstack sudo[100866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-022c8871-62ab-499d-86d4-5f0fac7c8f8e 1073741824
Sep 28 18:18:44 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:44 devstack sudo[100867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629
Sep 28 18:18:44 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:44 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-834d1b74-1b90-476b-814c-2268a688590c tempest-SnapshotDependencyTests-582505932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114.41501b4d-98e4-45b6-8140-0d2db9d14629" returned: 0 in 0.366s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-834d1b74-1b90-476b-814c-2268a688590c tempest-SnapshotDependencyTests-582505932 None] Lock "cinder-quobyte-41501b4d-98e4-45b6-8140-0d2db9d14629" released by "_delete_snapshot" :: held 2.938s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-834d1b74-1b90-476b-814c-2268a688590c tempest-SnapshotDependencyTests-582505932 None] Lock "cinder-quobyte-6f40e455-a06d-4163-8b7e-abed4bb69114" released by "delete_snapshot" :: held 2.992s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-834d1b74-1b90-476b-814c-2268a688590c tempest-SnapshotDependencyTests-582505932 None] Created reservations ['3918b2e4-db13-4d2a-a08e-212b044a2ace', '0b556d2c-cd80-4b91-9083-a10338f34ea2', '02fcbc9d-0b86-4941-a9bb-7989cf398da2', '4649f9f9-fdad-4f50-a5a5-fa684ee5e34f'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:18:44 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:44 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-834d1b74-1b90-476b-814c-2268a688590c tempest-SnapshotDependencyTests-582505932 None] Delete snapshot completed successfully.
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-022c8871-62ab-499d-86d4-5f0fac7c8f8e 1073741824" returned: 0 in 0.763s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-834d1b74-1b90-476b-814c-2268a688590c tempest-SnapshotDependencyTests-582505932 None] Lock "cinder-41501b4d-98e4-45b6-8140-0d2db9d14629-delete_snapshot" released by "delete_snapshot" :: held 3.325s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-022c8871-62ab-499d-86d4-5f0fac7c8f8e {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:45 devstack sudo[100875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-022c8871-62ab-499d-86d4-5f0fac7c8f8e
Sep 28 18:18:45 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:45 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-022c8871-62ab-499d-86d4-5f0fac7c8f8e" returned: 0 in 0.326s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:18:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73cace47-65b1-43d4-85c7-f505a0154c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-022c8871-62ab-499d-86d4-5f0fac7c8f8e', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb0bffd-ebde-4ecf-93ff-77b038bff968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:45 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Volume volume-022c8871-62ab-499d-86d4-5f0fac7c8f8e (022c8871-62ab-499d-86d4-5f0fac7c8f8e): created successfully
Sep 28 18:18:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb0bffd-ebde-4ecf-93ff-77b038bff968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Flow 'volume_create_manager' (4930bef7-8a2e-40b9-a2d0-98858b9d0e9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:45 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-f1ab9513-c50f-4f09-9989-b84bef14d96a tempest-VolumesGetTest-374048226 None] Created volume successfully.
Sep 28 18:18:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-588490ab-2526-4151-aee3-5721d129f15a tempest-SnapshotDependencyTests-582505932 None] Acquiring lock "cinder-6f40e455-a06d-4163-8b7e-abed4bb69114-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-588490ab-2526-4151-aee3-5721d129f15a tempest-SnapshotDependencyTests-582505932 None] Lock "cinder-6f40e455-a06d-4163-8b7e-abed4bb69114-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-588490ab-2526-4151-aee3-5721d129f15a tempest-SnapshotDependencyTests-582505932 None] Acquiring lock "cinder-quobyte-6f40e455-a06d-4163-8b7e-abed4bb69114" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-588490ab-2526-4151-aee3-5721d129f15a tempest-SnapshotDependencyTests-582505932 None] Lock "cinder-quobyte-6f40e455-a06d-4163-8b7e-abed4bb69114" acquired by "delete_volume" :: waited 0.034s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:46 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb46920e-64a6-495d-84ea-7ed3f88c1ad8]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-588490ab-2526-4151-aee3-5721d129f15a tempest-SnapshotDependencyTests-582505932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:46 devstack sudo[100878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114
Sep 28 18:18:46 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-96c397b4-5ca1-4914-959a-2dc13aa32d28 tempest-VolumesGetTest-374048226 None] Acquiring lock "cinder-022c8871-62ab-499d-86d4-5f0fac7c8f8e-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-96c397b4-5ca1-4914-959a-2dc13aa32d28 tempest-VolumesGetTest-374048226 None] Lock "cinder-022c8871-62ab-499d-86d4-5f0fac7c8f8e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-96c397b4-5ca1-4914-959a-2dc13aa32d28 tempest-VolumesGetTest-374048226 None] Acquiring lock "cinder-quobyte-022c8871-62ab-499d-86d4-5f0fac7c8f8e" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-96c397b4-5ca1-4914-959a-2dc13aa32d28 tempest-VolumesGetTest-374048226 None] Lock "cinder-quobyte-022c8871-62ab-499d-86d4-5f0fac7c8f8e" acquired by "delete_volume" :: waited 0.030s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:46 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[05387c58-b49b-4def-86d5-c1bf92219feb]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-96c397b4-5ca1-4914-959a-2dc13aa32d28 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-022c8871-62ab-499d-86d4-5f0fac7c8f8e {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:46 devstack sudo[100880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-022c8871-62ab-499d-86d4-5f0fac7c8f8e
Sep 28 18:18:46 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:46 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-588490ab-2526-4151-aee3-5721d129f15a tempest-SnapshotDependencyTests-582505932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114" returned: 0 in 0.627s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-588490ab-2526-4151-aee3-5721d129f15a tempest-SnapshotDependencyTests-582505932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:46 devstack sudo[100885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114
Sep 28 18:18:46 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:47 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-96c397b4-5ca1-4914-959a-2dc13aa32d28 tempest-VolumesGetTest-374048226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-022c8871-62ab-499d-86d4-5f0fac7c8f8e" returned: 0 in 0.662s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-96c397b4-5ca1-4914-959a-2dc13aa32d28 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-022c8871-62ab-499d-86d4-5f0fac7c8f8e {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:47 devstack sudo[100890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-022c8871-62ab-499d-86d4-5f0fac7c8f8e
Sep 28 18:18:47 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:47 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-588490ab-2526-4151-aee3-5721d129f15a tempest-SnapshotDependencyTests-582505932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6f40e455-a06d-4163-8b7e-abed4bb69114" returned: 0 in 0.535s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-588490ab-2526-4151-aee3-5721d129f15a tempest-SnapshotDependencyTests-582505932 None] Lock "cinder-quobyte-6f40e455-a06d-4163-8b7e-abed4bb69114" released by "delete_volume" :: held 1.267s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Flow 'volume_create_manager' (979a9806-6100-4a4d-9c1e-0a2ff86c4ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4434bb6c-74d4-4d9b-b0fc-4801d379475b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4434bb6c-74d4-4d9b-b0fc-4801d379475b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-286808774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0763e75d-8cdc-4e00-83db-369ff938f0f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99cd3df28df346b5a533a9eb26c82f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:47Z,use_quota=True,user_id='48a5aa6a0b004e45be53706b58afc3a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa60054-5ba3-4fdd-b24b-9b4f429f95c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa60054-5ba3-4fdd-b24b-9b4f429f95c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8a464d-3c19-40b4-9745-0c465fea87ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8a464d-3c19-40b4-9745-0c465fea87ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0763e75d-8cdc-4e00-83db-369ff938f0f6', 'volume_name': 'volume-0763e75d-8cdc-4e00-83db-369ff938f0f6', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d6c8e99-f7aa-4830-9882-a4ca7a9fd556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d6c8e99-f7aa-4830-9882-a4ca7a9fd556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b314b5ad-1f28-411e-94af-3301c4d13d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:47 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Volume 0763e75d-8cdc-4e00-83db-369ff938f0f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0763e75d-8cdc-4e00-83db-369ff938f0f6', 'volume_size': 1}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-286808774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0763e75d-8cdc-4e00-83db-369ff938f0f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99cd3df28df346b5a533a9eb26c82f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:47Z,use_quota=True,user_id='48a5aa6a0b004e45be53706b58afc3a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Creating volume 0763e75d-8cdc-4e00-83db-369ff938f0f6 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:18:47 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0763e75d-8cdc-4e00-83db-369ff938f0f6 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:47 devstack sudo[100893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0763e75d-8cdc-4e00-83db-369ff938f0f6 1073741824
Sep 28 18:18:47 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-588490ab-2526-4151-aee3-5721d129f15a tempest-SnapshotDependencyTests-582505932 None] Created reservations ['8df173f3-38f9-4b41-a3c0-f94f2cbd94f4', '7f155243-82fe-479f-92d6-635bff303aa4', '51f11e55-3ab0-4d54-86f6-01d96bf6607c', '05d0be47-ad40-4ca1-9b72-4c99f73e7e8e'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:18:47 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-96c397b4-5ca1-4914-959a-2dc13aa32d28 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-022c8871-62ab-499d-86d4-5f0fac7c8f8e" returned: 0 in 0.360s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-96c397b4-5ca1-4914-959a-2dc13aa32d28 tempest-VolumesGetTest-374048226 None] Lock "cinder-quobyte-022c8871-62ab-499d-86d4-5f0fac7c8f8e" released by "delete_volume" :: held 1.105s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-588490ab-2526-4151-aee3-5721d129f15a tempest-SnapshotDependencyTests-582505932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-588490ab-2526-4151-aee3-5721d129f15a tempest-SnapshotDependencyTests-582505932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-588490ab-2526-4151-aee3-5721d129f15a tempest-SnapshotDependencyTests-582505932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-588490ab-2526-4151-aee3-5721d129f15a tempest-SnapshotDependencyTests-582505932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-588490ab-2526-4151-aee3-5721d129f15a tempest-SnapshotDependencyTests-582505932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-588490ab-2526-4151-aee3-5721d129f15a tempest-SnapshotDependencyTests-582505932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:47 devstack sudo[100896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:18:47 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-96c397b4-5ca1-4914-959a-2dc13aa32d28 tempest-VolumesGetTest-374048226 None] Created reservations ['2c20b873-cddd-4da1-996a-a4e0a02d41ad', '88d10f82-be1d-48d3-86af-8a129c71af54', 'f7533ba9-81e2-4085-8c18-f0e21b77d930', 'c3b835b7-e82a-4906-8a75-fe6b0140f8cd'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-96c397b4-5ca1-4914-959a-2dc13aa32d28 tempest-VolumesGetTest-374048226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-96c397b4-5ca1-4914-959a-2dc13aa32d28 tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-96c397b4-5ca1-4914-959a-2dc13aa32d28 tempest-VolumesGetTest-374048226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-96c397b4-5ca1-4914-959a-2dc13aa32d28 tempest-VolumesGetTest-374048226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-96c397b4-5ca1-4914-959a-2dc13aa32d28 tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-96c397b4-5ca1-4914-959a-2dc13aa32d28 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:47 devstack sudo[100901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:18:47 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:48 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-588490ab-2526-4151-aee3-5721d129f15a tempest-SnapshotDependencyTests-582505932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.326s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-588490ab-2526-4151-aee3-5721d129f15a tempest-SnapshotDependencyTests-582505932 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:18:48 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-588490ab-2526-4151-aee3-5721d129f15a tempest-SnapshotDependencyTests-582505932 None] Deleted volume successfully.
Sep 28 18:18:48 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0763e75d-8cdc-4e00-83db-369ff938f0f6 1073741824" returned: 0 in 0.604s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-588490ab-2526-4151-aee3-5721d129f15a tempest-SnapshotDependencyTests-582505932 None] Lock "cinder-6f40e455-a06d-4163-8b7e-abed4bb69114-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0763e75d-8cdc-4e00-83db-369ff938f0f6 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:48 devstack sudo[100905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0763e75d-8cdc-4e00-83db-369ff938f0f6
Sep 28 18:18:48 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:48 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-96c397b4-5ca1-4914-959a-2dc13aa32d28 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.361s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-96c397b4-5ca1-4914-959a-2dc13aa32d28 tempest-VolumesGetTest-374048226 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:18:48 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-96c397b4-5ca1-4914-959a-2dc13aa32d28 tempest-VolumesGetTest-374048226 None] Deleted volume successfully.
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-96c397b4-5ca1-4914-959a-2dc13aa32d28 tempest-VolumesGetTest-374048226 None] Lock "cinder-022c8871-62ab-499d-86d4-5f0fac7c8f8e-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-15d3c9ca-930e-4669-9e57-32e8a648d992 tempest-SnapshotDependencyTests-582505932 None] Acquiring lock "cinder-9756aaa7-da30-4ca1-9aae-53436f2ca897-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-15d3c9ca-930e-4669-9e57-32e8a648d992 tempest-SnapshotDependencyTests-582505932 None] Lock "cinder-9756aaa7-da30-4ca1-9aae-53436f2ca897-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-15d3c9ca-930e-4669-9e57-32e8a648d992 tempest-SnapshotDependencyTests-582505932 None] Acquiring lock "cinder-quobyte-9756aaa7-da30-4ca1-9aae-53436f2ca897" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-15d3c9ca-930e-4669-9e57-32e8a648d992 tempest-SnapshotDependencyTests-582505932 None] Lock "cinder-quobyte-9756aaa7-da30-4ca1-9aae-53436f2ca897" acquired by "delete_volume" :: waited 0.015s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4650663a-2909-468e-b568-22b2cace3534]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-15d3c9ca-930e-4669-9e57-32e8a648d992 tempest-SnapshotDependencyTests-582505932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9756aaa7-da30-4ca1-9aae-53436f2ca897 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:48 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0763e75d-8cdc-4e00-83db-369ff938f0f6" returned: 0 in 0.357s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b314b5ad-1f28-411e-94af-3301c4d13d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0763e75d-8cdc-4e00-83db-369ff938f0f6', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bece3d2-5afe-44c8-b7b6-58750f9d30a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:48 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Volume volume-0763e75d-8cdc-4e00-83db-369ff938f0f6 (0763e75d-8cdc-4e00-83db-369ff938f0f6): created successfully
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bece3d2-5afe-44c8-b7b6-58750f9d30a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Flow 'volume_create_manager' (979a9806-6100-4a4d-9c1e-0a2ff86c4ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:48 devstack sudo[100908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9756aaa7-da30-4ca1-9aae-53436f2ca897
Sep 28 18:18:48 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:48 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-c28409c3-5bc6-4409-b0ff-5241ad53f8e6 tempest-VolumeQuotasAdminTestJSON-391004397 None] Created volume successfully.
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6c8415e8-9df8-4be0-bb33-9d7dfeade60b tempest-VolumesGetTest-374048226 None] Acquiring lock "cinder-cdd47450-ff44-4f28-be6c-23b2a04cc8e4-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6c8415e8-9df8-4be0-bb33-9d7dfeade60b tempest-VolumesGetTest-374048226 None] Lock "cinder-cdd47450-ff44-4f28-be6c-23b2a04cc8e4-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6c8415e8-9df8-4be0-bb33-9d7dfeade60b tempest-VolumesGetTest-374048226 None] Acquiring lock "cinder-quobyte-cdd47450-ff44-4f28-be6c-23b2a04cc8e4" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6c8415e8-9df8-4be0-bb33-9d7dfeade60b tempest-VolumesGetTest-374048226 None] Lock "cinder-quobyte-cdd47450-ff44-4f28-be6c-23b2a04cc8e4" acquired by "delete_volume" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:49 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-15d3c9ca-930e-4669-9e57-32e8a648d992 tempest-SnapshotDependencyTests-582505932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9756aaa7-da30-4ca1-9aae-53436f2ca897" returned: 0 in 0.555s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-15d3c9ca-930e-4669-9e57-32e8a648d992 tempest-SnapshotDependencyTests-582505932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9756aaa7-da30-4ca1-9aae-53436f2ca897 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:49 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49aff91-3c3f-4e77-9827-9e36837fe512]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6c8415e8-9df8-4be0-bb33-9d7dfeade60b tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cdd47450-ff44-4f28-be6c-23b2a04cc8e4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:49 devstack sudo[100914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9756aaa7-da30-4ca1-9aae-53436f2ca897
Sep 28 18:18:49 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:49 devstack sudo[100915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cdd47450-ff44-4f28-be6c-23b2a04cc8e4
Sep 28 18:18:49 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:49 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-15d3c9ca-930e-4669-9e57-32e8a648d992 tempest-SnapshotDependencyTests-582505932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9756aaa7-da30-4ca1-9aae-53436f2ca897" returned: 0 in 0.305s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-15d3c9ca-930e-4669-9e57-32e8a648d992 tempest-SnapshotDependencyTests-582505932 None] Lock "cinder-quobyte-9756aaa7-da30-4ca1-9aae-53436f2ca897" released by "delete_volume" :: held 0.918s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:49 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-15d3c9ca-930e-4669-9e57-32e8a648d992 tempest-SnapshotDependencyTests-582505932 None] Created reservations ['0c797bc7-9240-482e-8652-e3daf235faa3', '2c7bdea9-ef52-41ac-b1c3-506eb813bbe0', '25514ba0-fe30-4e8c-bd7e-069290f3cddd', 'dbc4900c-4727-4db6-bcc0-2cfa39e7f641'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:18:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-15d3c9ca-930e-4669-9e57-32e8a648d992 tempest-SnapshotDependencyTests-582505932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-15d3c9ca-930e-4669-9e57-32e8a648d992 tempest-SnapshotDependencyTests-582505932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-15d3c9ca-930e-4669-9e57-32e8a648d992 tempest-SnapshotDependencyTests-582505932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-15d3c9ca-930e-4669-9e57-32e8a648d992 tempest-SnapshotDependencyTests-582505932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-15d3c9ca-930e-4669-9e57-32e8a648d992 tempest-SnapshotDependencyTests-582505932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-15d3c9ca-930e-4669-9e57-32e8a648d992 tempest-SnapshotDependencyTests-582505932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:49 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-58a0dcc3-965d-4869-a561-d7f2efaeb12c tempest-VolumeQuotasAdminTestJSON-391004397 None] Acquiring lock "cinder-0763e75d-8cdc-4e00-83db-369ff938f0f6-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6c8415e8-9df8-4be0-bb33-9d7dfeade60b tempest-VolumesGetTest-374048226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cdd47450-ff44-4f28-be6c-23b2a04cc8e4" returned: 0 in 0.559s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6c8415e8-9df8-4be0-bb33-9d7dfeade60b tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cdd47450-ff44-4f28-be6c-23b2a04cc8e4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:49 devstack sudo[100922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:18:49 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-58a0dcc3-965d-4869-a561-d7f2efaeb12c tempest-VolumeQuotasAdminTestJSON-391004397 None] Lock "cinder-0763e75d-8cdc-4e00-83db-369ff938f0f6-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:49 devstack sudo[100923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cdd47450-ff44-4f28-be6c-23b2a04cc8e4
Sep 28 18:18:49 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-58a0dcc3-965d-4869-a561-d7f2efaeb12c tempest-VolumeQuotasAdminTestJSON-391004397 None] Acquiring lock "cinder-quobyte-0763e75d-8cdc-4e00-83db-369ff938f0f6" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-58a0dcc3-965d-4869-a561-d7f2efaeb12c tempest-VolumeQuotasAdminTestJSON-391004397 None] Lock "cinder-quobyte-0763e75d-8cdc-4e00-83db-369ff938f0f6" acquired by "delete_volume" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:49 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[639809bc-7563-4d7e-95d1-f11dbcd9b2db]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-58a0dcc3-965d-4869-a561-d7f2efaeb12c tempest-VolumeQuotasAdminTestJSON-391004397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0763e75d-8cdc-4e00-83db-369ff938f0f6 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:50 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6c8415e8-9df8-4be0-bb33-9d7dfeade60b tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cdd47450-ff44-4f28-be6c-23b2a04cc8e4" returned: 0 in 0.476s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:50 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6c8415e8-9df8-4be0-bb33-9d7dfeade60b tempest-VolumesGetTest-374048226 None] Lock "cinder-quobyte-cdd47450-ff44-4f28-be6c-23b2a04cc8e4" released by "delete_volume" :: held 1.114s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:50 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-15d3c9ca-930e-4669-9e57-32e8a648d992 tempest-SnapshotDependencyTests-582505932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.563s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:50 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-15d3c9ca-930e-4669-9e57-32e8a648d992 tempest-SnapshotDependencyTests-582505932 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:18:50 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-15d3c9ca-930e-4669-9e57-32e8a648d992 tempest-SnapshotDependencyTests-582505932 None] Deleted volume successfully.
Sep 28 18:18:50 devstack sudo[100926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0763e75d-8cdc-4e00-83db-369ff938f0f6
Sep 28 18:18:50 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:50 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-15d3c9ca-930e-4669-9e57-32e8a648d992 tempest-SnapshotDependencyTests-582505932 None] Lock "cinder-9756aaa7-da30-4ca1-9aae-53436f2ca897-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:50 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-6c8415e8-9df8-4be0-bb33-9d7dfeade60b tempest-VolumesGetTest-374048226 None] Created reservations ['61b352bc-1c03-48de-9898-d44339e03982', '7820a54b-9cca-49c2-ac85-649283311d23', '973b2a9d-cf3b-47d2-aa41-b50583147f74', '05669ced-e405-4f09-8134-47d295aca7e7'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:18:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6c8415e8-9df8-4be0-bb33-9d7dfeade60b tempest-VolumesGetTest-374048226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6c8415e8-9df8-4be0-bb33-9d7dfeade60b tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6c8415e8-9df8-4be0-bb33-9d7dfeade60b tempest-VolumesGetTest-374048226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6c8415e8-9df8-4be0-bb33-9d7dfeade60b tempest-VolumesGetTest-374048226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6c8415e8-9df8-4be0-bb33-9d7dfeade60b tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6c8415e8-9df8-4be0-bb33-9d7dfeade60b tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:50 devstack sudo[100930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:18:50 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:50 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-58a0dcc3-965d-4869-a561-d7f2efaeb12c tempest-VolumeQuotasAdminTestJSON-391004397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0763e75d-8cdc-4e00-83db-369ff938f0f6" returned: 0 in 0.609s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-58a0dcc3-965d-4869-a561-d7f2efaeb12c tempest-VolumeQuotasAdminTestJSON-391004397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0763e75d-8cdc-4e00-83db-369ff938f0f6 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:50 devstack sudo[100935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0763e75d-8cdc-4e00-83db-369ff938f0f6
Sep 28 18:18:50 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:50 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6c8415e8-9df8-4be0-bb33-9d7dfeade60b tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.370s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:50 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-6c8415e8-9df8-4be0-bb33-9d7dfeade60b tempest-VolumesGetTest-374048226 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:18:50 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-6c8415e8-9df8-4be0-bb33-9d7dfeade60b tempest-VolumesGetTest-374048226 None] Deleted volume successfully.
Sep 28 18:18:50 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6c8415e8-9df8-4be0-bb33-9d7dfeade60b tempest-VolumesGetTest-374048226 None] Lock "cinder-cdd47450-ff44-4f28-be6c-23b2a04cc8e4-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:50 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-58a0dcc3-965d-4869-a561-d7f2efaeb12c tempest-VolumeQuotasAdminTestJSON-391004397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0763e75d-8cdc-4e00-83db-369ff938f0f6" returned: 0 in 0.391s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:50 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-58a0dcc3-965d-4869-a561-d7f2efaeb12c tempest-VolumeQuotasAdminTestJSON-391004397 None] Lock "cinder-quobyte-0763e75d-8cdc-4e00-83db-369ff938f0f6" released by "delete_volume" :: held 1.099s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:51 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-58a0dcc3-965d-4869-a561-d7f2efaeb12c tempest-VolumeQuotasAdminTestJSON-391004397 None] Created reservations ['6816bb38-4194-4c61-aeaa-1cca9845d8fc', '630cce00-3e8d-4516-9442-57f9add33935', 'a4020254-dbbf-449f-82b1-382e3e711fae', 'fbce9c1d-16d4-4155-82e8-c3cdde8bc187'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:18:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-58a0dcc3-965d-4869-a561-d7f2efaeb12c tempest-VolumeQuotasAdminTestJSON-391004397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-58a0dcc3-965d-4869-a561-d7f2efaeb12c tempest-VolumeQuotasAdminTestJSON-391004397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-58a0dcc3-965d-4869-a561-d7f2efaeb12c tempest-VolumeQuotasAdminTestJSON-391004397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-58a0dcc3-965d-4869-a561-d7f2efaeb12c tempest-VolumeQuotasAdminTestJSON-391004397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-58a0dcc3-965d-4869-a561-d7f2efaeb12c tempest-VolumeQuotasAdminTestJSON-391004397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-58a0dcc3-965d-4869-a561-d7f2efaeb12c tempest-VolumeQuotasAdminTestJSON-391004397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:51 devstack sudo[100939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:18:51 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:51 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-58a0dcc3-965d-4869-a561-d7f2efaeb12c tempest-VolumeQuotasAdminTestJSON-391004397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.335s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:51 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-58a0dcc3-965d-4869-a561-d7f2efaeb12c tempest-VolumeQuotasAdminTestJSON-391004397 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:18:51 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-58a0dcc3-965d-4869-a561-d7f2efaeb12c tempest-VolumeQuotasAdminTestJSON-391004397 None] Deleted volume successfully.
Sep 28 18:18:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-58a0dcc3-965d-4869-a561-d7f2efaeb12c tempest-VolumeQuotasAdminTestJSON-391004397 None] Lock "cinder-0763e75d-8cdc-4e00-83db-369ff938f0f6-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Flow 'volume_create_manager' (606a2cd8-bde1-4330-b306-6da634d566ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94994b3d-c9e1-47c8-bef4-f81b844911e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94994b3d-c9e1-47c8-bef4-f81b844911e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1122904695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe52070-8503-4c6c-9b25-ad178a362602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b02642c5af4545836c283fc55b2409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:52Z,use_quota=True,user_id='825254fe29324576a8a7855a200e4b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c8f91e-7843-4d79-8afc-f230208c7741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c8f91e-7843-4d79-8afc-f230208c7741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85aecb4f-2229-4efb-928f-0908b020c904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85aecb4f-2229-4efb-928f-0908b020c904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fe52070-8503-4c6c-9b25-ad178a362602', 'volume_name': 'volume-2fe52070-8503-4c6c-9b25-ad178a362602', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee1a3a3-d0af-4d4c-92ed-957b0d25a227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee1a3a3-d0af-4d4c-92ed-957b0d25a227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75634ff3-d7d9-4c54-b66e-2a1144f144bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:52 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Volume 2fe52070-8503-4c6c-9b25-ad178a362602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fe52070-8503-4c6c-9b25-ad178a362602', 'volume_size': 1}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1122904695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe52070-8503-4c6c-9b25-ad178a362602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b02642c5af4545836c283fc55b2409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:52Z,use_quota=True,user_id='825254fe29324576a8a7855a200e4b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Creating volume 2fe52070-8503-4c6c-9b25-ad178a362602 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:18:52 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:52 devstack sudo[100942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602 1073741824
Sep 28 18:18:52 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Flow 'volume_create_manager' (0c74adee-89e1-4d90-be6a-8b1f45b69f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6adc84-b708-4105-8317-878e6bf2e39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6adc84-b708-4105-8317-878e6bf2e39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-27908554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0358242-ec6d-4480-9c14-5eaabb39ece0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99cd3df28df346b5a533a9eb26c82f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:53Z,use_quota=True,user_id='48a5aa6a0b004e45be53706b58afc3a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4048fb75-8b14-43d3-849d-d404a14abb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4048fb75-8b14-43d3-849d-d404a14abb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32fdc7ee-f77d-411f-81b5-a6798667ddc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32fdc7ee-f77d-411f-81b5-a6798667ddc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0358242-ec6d-4480-9c14-5eaabb39ece0', 'volume_name': 'volume-d0358242-ec6d-4480-9c14-5eaabb39ece0', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31fbf6a3-faf3-49b1-885e-4f2679026cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31fbf6a3-faf3-49b1-885e-4f2679026cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e82266d-35e1-4e4e-bec9-6725d8e1dfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:52 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Volume d0358242-ec6d-4480-9c14-5eaabb39ece0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0358242-ec6d-4480-9c14-5eaabb39ece0', 'volume_size': 1}
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:52 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602 1073741824" returned: 0 in 0.687s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:53 devstack sudo[100950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602
Sep 28 18:18:53 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:53 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602" returned: 0 in 0.376s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:18:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.508s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-27908554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0358242-ec6d-4480-9c14-5eaabb39ece0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99cd3df28df346b5a533a9eb26c82f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:53Z,use_quota=True,user_id='48a5aa6a0b004e45be53706b58afc3a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:18:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Creating volume d0358242-ec6d-4480-9c14-5eaabb39ece0 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:18:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:18:53 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:18:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d0358242-ec6d-4480-9c14-5eaabb39ece0 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75634ff3-d7d9-4c54-b66e-2a1144f144bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fe52070-8503-4c6c-9b25-ad178a362602', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65adb5f5-f0c7-4b2c-985c-8d8787ca838a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:53 devstack sudo[100953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d0358242-ec6d-4480-9c14-5eaabb39ece0 1073741824
Sep 28 18:18:53 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:53 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Volume volume-2fe52070-8503-4c6c-9b25-ad178a362602 (2fe52070-8503-4c6c-9b25-ad178a362602): created successfully
Sep 28 18:18:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65adb5f5-f0c7-4b2c-985c-8d8787ca838a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Flow 'volume_create_manager' (606a2cd8-bde1-4330-b306-6da634d566ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:53 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-75c60f73-167d-4c0e-8480-7a5c9e71c4cf tempest-VolumesGetTest-374048226 None] Created volume successfully.
Sep 28 18:18:54 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d0358242-ec6d-4480-9c14-5eaabb39ece0 1073741824" returned: 0 in 0.780s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d0358242-ec6d-4480-9c14-5eaabb39ece0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:54 devstack sudo[100959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d0358242-ec6d-4480-9c14-5eaabb39ece0
Sep 28 18:18:54 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:54 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d0358242-ec6d-4480-9c14-5eaabb39ece0" returned: 0 in 0.476s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:54 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:18:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e82266d-35e1-4e4e-bec9-6725d8e1dfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0358242-ec6d-4480-9c14-5eaabb39ece0', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7ece0b-16bb-4d62-9717-e1f1a637cf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:54 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Volume volume-d0358242-ec6d-4480-9c14-5eaabb39ece0 (d0358242-ec6d-4480-9c14-5eaabb39ece0): created successfully
Sep 28 18:18:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7ece0b-16bb-4d62-9717-e1f1a637cf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Flow 'volume_create_manager' (0c74adee-89e1-4d90-be6a-8b1f45b69f5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:54 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-462de540-88e5-4027-9ddf-dd7acb4eac3d tempest-VolumeQuotasAdminTestJSON-391004397 None] Created volume successfully.
Sep 28 18:18:55 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:18:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Flow 'volume_create_manager' (ac9711ef-0fde-4693-9b8e-a44f40df2d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:18:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3de7a4-9f71-4927-b083-5a9d95c0d0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3de7a4-9f71-4927-b083-5a9d95c0d0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-358349908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15b13cf-2b4d-46d0-b66a-842aad5a2659,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94b02642c5af4545836c283fc55b2409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=2fe52070-8503-4c6c-9b25-ad178a362602,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:55Z,use_quota=True,user_id='825254fe29324576a8a7855a200e4b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed1d1e8-23fd-4fe2-9e7a-675130a032bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed1d1e8-23fd-4fe2-9e7a-675130a032bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026d8343-cb45-4ef7-a874-c39efa692b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026d8343-cb45-4ef7-a874-c39efa692b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b15b13cf-2b4d-46d0-b66a-842aad5a2659', 'volume_name': 'volume-b15b13cf-2b4d-46d0-b66a-842aad5a2659', 'volume_size': 1, 'source_volid': '2fe52070-8503-4c6c-9b25-ad178a362602', 'source_volstatus': 'available'}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d7746f-0b98-4999-bc2a-ab11fb1130cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d7746f-0b98-4999-bc2a-ab11fb1130cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:18:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae263c6c-4763-49e2-8ac5-18186c81cd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:18:55 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Volume b15b13cf-2b4d-46d0-b66a-842aad5a2659: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b15b13cf-2b4d-46d0-b66a-842aad5a2659', 'volume_size': 1, 'source_volid': '2fe52070-8503-4c6c-9b25-ad178a362602', 'source_volstatus': 'available'}
Sep 28 18:18:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:55 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Cloning volume 2fe52070-8503-4c6c-9b25-ad178a362602 to volume b15b13cf-2b4d-46d0-b66a-842aad5a2659
Sep 28 18:18:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Creating offline snapshot 0eaf0be6-331d-417c-a03d-53727b0484d8 of volume 2fe52070-8503-4c6c-9b25-ad178a362602 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:18:55 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea40145-8687-4a74-b617-bbaa2141341e]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:56 devstack sudo[100962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602
Sep 28 18:18:56 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:56 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602" returned: 0 in 0.817s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:56 devstack sudo[100967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8 1G
Sep 28 18:18:56 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:57 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8 1G" returned: 0 in 0.836s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe52070-8503-4c6c-9b25-ad178a362602 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:57 devstack sudo[100973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe52070-8503-4c6c-9b25-ad178a362602 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8
Sep 28 18:18:57 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:57 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-1ed91196-0035-4a2a-adf9-8455a53bffe7 tempest-VolumeQuotasAdminTestJSON-467948165 None] Transfer volume completed successfully.
Sep 28 18:18:58 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe52070-8503-4c6c-9b25-ad178a362602 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8" returned: 0 in 0.655s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:58 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8 is being set with open permissions: ugo+rw
Sep 28 18:18:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:58 devstack sudo[100979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8
Sep 28 18:18:58 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:58 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8" returned: 0 in 0.373s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:58 devstack sudo[100982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.info
Sep 28 18:18:58 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6665019b-8c34-4836-80ab-2be3801506ed tempest-VolumeQuotasAdminTestJSON-747505963 None] Acquiring lock "cinder-d0358242-ec6d-4480-9c14-5eaabb39ece0-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6665019b-8c34-4836-80ab-2be3801506ed tempest-VolumeQuotasAdminTestJSON-747505963 None] Lock "cinder-d0358242-ec6d-4480-9c14-5eaabb39ece0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6665019b-8c34-4836-80ab-2be3801506ed tempest-VolumeQuotasAdminTestJSON-747505963 None] Acquiring lock "cinder-quobyte-d0358242-ec6d-4480-9c14-5eaabb39ece0" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6665019b-8c34-4836-80ab-2be3801506ed tempest-VolumeQuotasAdminTestJSON-747505963 None] Lock "cinder-quobyte-d0358242-ec6d-4480-9c14-5eaabb39ece0" acquired by "delete_volume" :: waited 0.033s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:59 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a5fa41-7b0d-4e84-8c27-5120b035aaf0]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6665019b-8c34-4836-80ab-2be3801506ed tempest-VolumeQuotasAdminTestJSON-747505963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d0358242-ec6d-4480-9c14-5eaabb39ece0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:59 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.info" returned: 0 in 0.595s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:59 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.info is being set with open permissions: ugo+rw
Sep 28 18:18:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:59 devstack sudo[100986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.info
Sep 28 18:18:59 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:59 devstack sudo[100985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d0358242-ec6d-4480-9c14-5eaabb39ece0
Sep 28 18:18:59 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:59 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.info" returned: 0 in 0.439s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:59 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Acquiring lock "cinder-quobyte-b15b13cf-2b4d-46d0-b66a-842aad5a2659" by "_copy_volume_from_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:18:59 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Lock "cinder-quobyte-b15b13cf-2b4d-46d0-b66a-842aad5a2659" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:18:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] snapshot: 0eaf0be6-331d-417c-a03d-53727b0484d8, volume: b15b13cf-2b4d-46d0-b66a-842aad5a2659,  {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 28 18:18:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:18:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:18:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:18:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:18:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:18:59 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fbe586-111b-4f0d-806a-faf74e95ba08]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:18:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:59 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root
Sep 28 18:18:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6665019b-8c34-4836-80ab-2be3801506ed tempest-VolumeQuotasAdminTestJSON-747505963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d0358242-ec6d-4480-9c14-5eaabb39ece0" returned: 0 in 0.614s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:18:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6665019b-8c34-4836-80ab-2be3801506ed tempest-VolumeQuotasAdminTestJSON-747505963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d0358242-ec6d-4480-9c14-5eaabb39ece0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:18:59 devstack sudo[100994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d0358242-ec6d-4480-9c14-5eaabb39ece0
Sep 28 18:18:59 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:18:59 devstack sudo[100993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8
Sep 28 18:18:59 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:00 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6665019b-8c34-4836-80ab-2be3801506ed tempest-VolumeQuotasAdminTestJSON-747505963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d0358242-ec6d-4480-9c14-5eaabb39ece0" returned: 0 in 0.435s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6665019b-8c34-4836-80ab-2be3801506ed tempest-VolumeQuotasAdminTestJSON-747505963 None] Lock "cinder-quobyte-d0358242-ec6d-4480-9c14-5eaabb39ece0" released by "delete_volume" :: held 1.140s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:19:00 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-6665019b-8c34-4836-80ab-2be3801506ed tempest-VolumeQuotasAdminTestJSON-747505963 None] Created reservations ['cf2356a8-dc88-4812-b598-816542649f01', '287f835d-ec71-4bc2-bc40-755170b30dd9', '52d6bdc4-ca7a-4551-8bb0-4e4a46cd7c35', '8f900e87-e886-4a68-ae2a-50dad5e9a4bb'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:19:00 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8" returned: 0 in 0.696s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fe52070-8503-4c6c-9b25-ad178a362602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:19:00 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eecd28b-8e8a-4b4c-b663-6a607d77ead5]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:19:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6665019b-8c34-4836-80ab-2be3801506ed tempest-VolumeQuotasAdminTestJSON-747505963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6665019b-8c34-4836-80ab-2be3801506ed tempest-VolumeQuotasAdminTestJSON-747505963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6665019b-8c34-4836-80ab-2be3801506ed tempest-VolumeQuotasAdminTestJSON-747505963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:19:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6665019b-8c34-4836-80ab-2be3801506ed tempest-VolumeQuotasAdminTestJSON-747505963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:19:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6665019b-8c34-4836-80ab-2be3801506ed tempest-VolumeQuotasAdminTestJSON-747505963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6665019b-8c34-4836-80ab-2be3801506ed tempest-VolumeQuotasAdminTestJSON-747505963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:00 devstack sudo[101002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:19:00 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:00 devstack sudo[101001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602
Sep 28 18:19:00 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:00 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6665019b-8c34-4836-80ab-2be3801506ed tempest-VolumeQuotasAdminTestJSON-747505963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.331s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:00 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-6665019b-8c34-4836-80ab-2be3801506ed tempest-VolumeQuotasAdminTestJSON-747505963 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:19:00 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-6665019b-8c34-4836-80ab-2be3801506ed tempest-VolumeQuotasAdminTestJSON-747505963 None] Deleted volume successfully.
Sep 28 18:19:00 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=111,cinder:UPDATE=151,cinder:INSERT=43,cinder:DELETE=13 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:19:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6665019b-8c34-4836-80ab-2be3801506ed tempest-VolumeQuotasAdminTestJSON-747505963 None] Lock "cinder-d0358242-ec6d-4480-9c14-5eaabb39ece0-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:19:01 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602" returned: 0 in 0.688s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602 {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 28 18:19:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Creating direct copy from snapshot {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 28 18:19:01 devstack cinder-volume[87046]: DEBUG cinder.utils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Path /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b15b13cf-2b4d-46d0-b66a-842aad5a2659 not found in is_blk_device check {{(pid=87046) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 28 18:19:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b15b13cf-2b4d-46d0-b66a-842aad5a2659 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:01 devstack sudo[101016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b15b13cf-2b4d-46d0-b66a-842aad5a2659
Sep 28 18:19:01 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:10 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=48,cinder:UPDATE=76,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:19:12 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b15b13cf-2b4d-46d0-b66a-842aad5a2659" returned: 0 in 11.028s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:12 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Image conversion details: src /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602, size 1024.00 MB, duration 11.03 sec, destination /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b15b13cf-2b4d-46d0-b66a-842aad5a2659 {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:19:12 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Converted 1024.00 MB image at 92.84 MB/s
Sep 28 18:19:12 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b15b13cf-2b4d-46d0-b66a-842aad5a2659 is being set with open permissions: ugo+rw
Sep 28 18:19:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b15b13cf-2b4d-46d0-b66a-842aad5a2659 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:12 devstack sudo[101031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b15b13cf-2b4d-46d0-b66a-842aad5a2659
Sep 28 18:19:12 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:12 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b15b13cf-2b4d-46d0-b66a-842aad5a2659" returned: 0 in 0.537s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:12 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Lock "cinder-quobyte-b15b13cf-2b4d-46d0-b66a-842aad5a2659" released by "_copy_volume_from_snapshot" :: held 13.091s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:19:12 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Acquiring lock "cinder-quobyte-0eaf0be6-331d-417c-a03d-53727b0484d8" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:19:12 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Lock "cinder-quobyte-0eaf0be6-331d-417c-a03d-53727b0484d8" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:19:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Deleting offline snapshot 0eaf0be6-331d-417c-a03d-53727b0484d8 of volume 2fe52070-8503-4c6c-9b25-ad178a362602 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:19:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] snapshot_file for this snap is: volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:19:12 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a35a2d6-a85a-4de2-8447-379ef6daf883]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:19:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:12 devstack sudo[101035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8
Sep 28 18:19:12 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:13 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8" returned: 0 in 0.605s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:13 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fe52070-8503-4c6c-9b25-ad178a362602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:19:13 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b753000a-e3e5-4e67-ab36-75dc9116ab48]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:19:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:13 devstack sudo[101041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602
Sep 28 18:19:13 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:14 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602" returned: 0 in 0.837s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:14 devstack sudo[101046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8
Sep 28 18:19:14 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:15 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8" returned: 0 in 0.789s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:15 devstack sudo[101051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8
Sep 28 18:19:15 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:15 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602.0eaf0be6-331d-417c-a03d-53727b0484d8" returned: 0 in 0.376s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:15 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Lock "cinder-quobyte-0eaf0be6-331d-417c-a03d-53727b0484d8" released by "_delete_snapshot" :: held 2.837s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:19:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.041s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae263c6c-4763-49e2-8ac5-18186c81cd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b15b13cf-2b4d-46d0-b66a-842aad5a2659', 'volume_size': 1, 'source_volid': '2fe52070-8503-4c6c-9b25-ad178a362602', 'source_volstatus': 'available'}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72b9d7fe-6229-448f-8047-49aa3bf7d987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:15 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Volume volume-b15b13cf-2b4d-46d0-b66a-842aad5a2659 (b15b13cf-2b4d-46d0-b66a-842aad5a2659): created successfully
Sep 28 18:19:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72b9d7fe-6229-448f-8047-49aa3bf7d987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Flow 'volume_create_manager' (ac9711ef-0fde-4693-9b8e-a44f40df2d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:15 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-1b3b6569-ad66-4bcd-821c-0f816c1488a6 tempest-VolumesGetTest-374048226 None] Created volume successfully.
Sep 28 18:19:17 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:19:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Flow 'volume_create_manager' (389a1819-efcf-4e49-9c85-e23bcc81b41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489885ee-4db1-409b-894f-a7511e6cee8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489885ee-4db1-409b-894f-a7511e6cee8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:19:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-857147244',display_name='tempest-VolumesGetTest-Volume-1417625287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad07f90-d990-4266-9006-cdf75bef62a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b02642c5af4545836c283fc55b2409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:17Z,use_quota=True,user_id='825254fe29324576a8a7855a200e4b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e602320a-4540-4bf0-a8f6-7f89d999c1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e602320a-4540-4bf0-a8f6-7f89d999c1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7398db5-ccc0-441a-9cda-7687ffd52c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7398db5-ccc0-441a-9cda-7687ffd52c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bad07f90-d990-4266-9006-cdf75bef62a0', 'volume_name': 'volume-bad07f90-d990-4266-9006-cdf75bef62a0', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb87c47-121b-4677-b08e-eb1446ad94e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb87c47-121b-4677-b08e-eb1446ad94e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a818f9ef-a42e-4b39-a5d7-319711eba109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:17 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Volume bad07f90-d990-4266-9006-cdf75bef62a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bad07f90-d990-4266-9006-cdf75bef62a0', 'volume_size': 1}
Sep 28 18:19:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:19:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-857147244',display_name='tempest-VolumesGetTest-Volume-1417625287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad07f90-d990-4266-9006-cdf75bef62a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b02642c5af4545836c283fc55b2409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:17Z,use_quota=True,user_id='825254fe29324576a8a7855a200e4b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:19:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Creating volume bad07f90-d990-4266-9006-cdf75bef62a0 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:19:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:19:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:19:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:19:17 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:19:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bad07f90-d990-4266-9006-cdf75bef62a0 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:17 devstack sudo[101054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bad07f90-d990-4266-9006-cdf75bef62a0 1073741824
Sep 28 18:19:17 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:18 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bad07f90-d990-4266-9006-cdf75bef62a0 1073741824" returned: 0 in 0.840s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bad07f90-d990-4266-9006-cdf75bef62a0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:18 devstack sudo[101060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bad07f90-d990-4266-9006-cdf75bef62a0
Sep 28 18:19:18 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:19 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bad07f90-d990-4266-9006-cdf75bef62a0" returned: 0 in 0.418s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:19 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:19:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:19 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a818f9ef-a42e-4b39-a5d7-319711eba109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bad07f90-d990-4266-9006-cdf75bef62a0', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:19 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111dfbe1-03e7-4365-b106-5c5e50427627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:19 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Volume volume-bad07f90-d990-4266-9006-cdf75bef62a0 (bad07f90-d990-4266-9006-cdf75bef62a0): created successfully
Sep 28 18:19:19 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111dfbe1-03e7-4365-b106-5c5e50427627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:19 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Flow 'volume_create_manager' (389a1819-efcf-4e49-9c85-e23bcc81b41b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:19 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-63b90519-9e60-48a6-8f81-67f15996245a tempest-VolumesGetTest-374048226 None] Created volume successfully.
Sep 28 18:19:19 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:19:19 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Flow 'volume_create_manager' (0ec1d12a-e4e2-45a1-b3e4-23808e21c869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e293002-acb5-4496-9e61-54a2c6f265ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e293002-acb5-4496-9e61-54a2c6f265ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1316361935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff900d6f-a6c3-43eb-aa8e-1b68b6424f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebf4158c3f6498eabd8d95c624a8dfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:20Z,use_quota=True,user_id='74b7cc5c29af48c887ae78c9a0e9f31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4da893fb-6e2d-445e-9472-cd63c28a2faa),volume_type_id=4da893fb-6e2d-445e-9472-cd63c28a2faa)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d970f8a2-75f9-43e3-966c-7936fc6645ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d970f8a2-75f9-43e3-966c-7936fc6645ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796fa403-bddf-4fd6-9df3-3d5e11cd6e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796fa403-bddf-4fd6-9df3-3d5e11cd6e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff900d6f-a6c3-43eb-aa8e-1b68b6424f01', 'volume_name': 'volume-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992d2fcf-8bc2-41ad-bb30-c126bb419856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992d2fcf-8bc2-41ad-bb30-c126bb419856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf27daf-119e-4808-b189-554fd5348fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:20 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Volume ff900d6f-a6c3-43eb-aa8e-1b68b6424f01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01', 'volume_size': 1}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1316361935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff900d6f-a6c3-43eb-aa8e-1b68b6424f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebf4158c3f6498eabd8d95c624a8dfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:20Z,use_quota=True,user_id='74b7cc5c29af48c887ae78c9a0e9f31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4da893fb-6e2d-445e-9472-cd63c28a2faa),volume_type_id=4da893fb-6e2d-445e-9472-cd63c28a2faa)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Creating volume ff900d6f-a6c3-43eb-aa8e-1b68b6424f01 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:19:20 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0f6dbe12-2325-4e41-90b4-9ec9cb29f817 tempest-VolumesGetTest-374048226 None] Acquiring lock "cinder-bad07f90-d990-4266-9006-cdf75bef62a0-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0f6dbe12-2325-4e41-90b4-9ec9cb29f817 tempest-VolumesGetTest-374048226 None] Lock "cinder-bad07f90-d990-4266-9006-cdf75bef62a0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:19:20 devstack sudo[101064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01 1073741824
Sep 28 18:19:20 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0f6dbe12-2325-4e41-90b4-9ec9cb29f817 tempest-VolumesGetTest-374048226 None] Acquiring lock "cinder-quobyte-bad07f90-d990-4266-9006-cdf75bef62a0" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0f6dbe12-2325-4e41-90b4-9ec9cb29f817 tempest-VolumesGetTest-374048226 None] Lock "cinder-quobyte-bad07f90-d990-4266-9006-cdf75bef62a0" acquired by "delete_volume" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bedeab-9afa-4dbf-9d09-8b26b4b44d8d]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0f6dbe12-2325-4e41-90b4-9ec9cb29f817 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bad07f90-d990-4266-9006-cdf75bef62a0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:19:20 devstack sudo[101066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bad07f90-d990-4266-9006-cdf75bef62a0
Sep 28 18:19:20 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Flow 'volume_create_manager' (773ab52f-e5a2-4dd0-b524-206741d4c346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4783e53a-80ec-485f-b866-0d7d02d2c784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4783e53a-80ec-485f-b866-0d7d02d2c784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1414466786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4594be7a-b6e8-4244-9440-252941ab923a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebf4158c3f6498eabd8d95c624a8dfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:20Z,use_quota=True,user_id='74b7cc5c29af48c887ae78c9a0e9f31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(155c3f11-cd8d-47d4-bb78-9c667a158d3f),volume_type_id=155c3f11-cd8d-47d4-bb78-9c667a158d3f)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395efaee-ce07-4f32-bcdd-e3945c1685b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395efaee-ce07-4f32-bcdd-e3945c1685b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd137468-10b8-4081-beef-c007b104076a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd137468-10b8-4081-beef-c007b104076a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4594be7a-b6e8-4244-9440-252941ab923a', 'volume_name': 'volume-4594be7a-b6e8-4244-9440-252941ab923a', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64939e2f-697b-4e29-8fb1-97a3ba49c857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64939e2f-697b-4e29-8fb1-97a3ba49c857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9208a481-3b7a-4a9b-85e3-1dd5e1d9091b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:20 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Volume 4594be7a-b6e8-4244-9440-252941ab923a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4594be7a-b6e8-4244-9440-252941ab923a', 'volume_size': 1}
Sep 28 18:19:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:21 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01 1073741824" returned: 0 in 0.928s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:21 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0f6dbe12-2325-4e41-90b4-9ec9cb29f817 tempest-VolumesGetTest-374048226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bad07f90-d990-4266-9006-cdf75bef62a0" returned: 0 in 0.716s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0f6dbe12-2325-4e41-90b4-9ec9cb29f817 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bad07f90-d990-4266-9006-cdf75bef62a0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:21 devstack sudo[101078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bad07f90-d990-4266-9006-cdf75bef62a0
Sep 28 18:19:21 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:21 devstack sudo[101080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01
Sep 28 18:19:21 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:21 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0f6dbe12-2325-4e41-90b4-9ec9cb29f817 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-bad07f90-d990-4266-9006-cdf75bef62a0" returned: 0 in 0.422s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0f6dbe12-2325-4e41-90b4-9ec9cb29f817 tempest-VolumesGetTest-374048226 None] Lock "cinder-quobyte-bad07f90-d990-4266-9006-cdf75bef62a0" released by "delete_volume" :: held 1.230s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:19:21 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01" returned: 0 in 0.424s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.872s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1414466786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4594be7a-b6e8-4244-9440-252941ab923a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebf4158c3f6498eabd8d95c624a8dfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:20Z,use_quota=True,user_id='74b7cc5c29af48c887ae78c9a0e9f31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(155c3f11-cd8d-47d4-bb78-9c667a158d3f),volume_type_id=155c3f11-cd8d-47d4-bb78-9c667a158d3f)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Creating volume 4594be7a-b6e8-4244-9440-252941ab923a {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:19:21 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4594be7a-b6e8-4244-9440-252941ab923a 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:21 devstack sudo[101084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4594be7a-b6e8-4244-9440-252941ab923a 1073741824
Sep 28 18:19:21 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf27daf-119e-4808-b189-554fd5348fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b93d577-ce40-4a3e-8488-2cedb233bcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-0f6dbe12-2325-4e41-90b4-9ec9cb29f817 tempest-VolumesGetTest-374048226 None] Created reservations ['fcb3f786-5db6-4447-90ef-fda192834cad', '4bf39ec3-689a-427c-b7e6-566439d4df9b', 'd8b3ccd8-e703-4e26-acd4-f2753dcc3095', '3d4552e7-fe52-412a-9046-2ccea1a68edf'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:19:21 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Volume volume-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01 (ff900d6f-a6c3-43eb-aa8e-1b68b6424f01): created successfully
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b93d577-ce40-4a3e-8488-2cedb233bcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Flow 'volume_create_manager' (0ec1d12a-e4e2-45a1-b3e4-23808e21c869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:21 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-47b8b288-94e6-4a28-9c64-c7d7b3f8aace tempest-TestInstancesWithCinderVolumes-992173720 None] Created volume successfully.
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0f6dbe12-2325-4e41-90b4-9ec9cb29f817 tempest-VolumesGetTest-374048226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0f6dbe12-2325-4e41-90b4-9ec9cb29f817 tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0f6dbe12-2325-4e41-90b4-9ec9cb29f817 tempest-VolumesGetTest-374048226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0f6dbe12-2325-4e41-90b4-9ec9cb29f817 tempest-VolumesGetTest-374048226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0f6dbe12-2325-4e41-90b4-9ec9cb29f817 tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0f6dbe12-2325-4e41-90b4-9ec9cb29f817 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:22 devstack sudo[101088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:19:22 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Flow 'volume_create_manager' (c2f409b2-0463-4f3d-985d-81f06f53ddde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c26950-934d-45a1-a1ab-3d35bcf8b8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c26950-934d-45a1-a1ab-3d35bcf8b8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1257883957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff682bb-d526-40ce-ab25-afb0e4f1f871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebf4158c3f6498eabd8d95c624a8dfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:22Z,use_quota=True,user_id='74b7cc5c29af48c887ae78c9a0e9f31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f10b6631-0516-4903-981d-b0f46c776162),volume_type_id=f10b6631-0516-4903-981d-b0f46c776162)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f8183c-7a0c-407b-a341-e8b2fbd9b815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f8183c-7a0c-407b-a341-e8b2fbd9b815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800eda99-9328-4afb-817c-b798ce585520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.image.glance [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Creating Keystone auth plugin from conf {{(pid=87046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 28 18:19:22 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0f6dbe12-2325-4e41-90b4-9ec9cb29f817 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.418s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-0f6dbe12-2325-4e41-90b4-9ec9cb29f817 tempest-VolumesGetTest-374048226 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:19:22 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-0f6dbe12-2325-4e41-90b4-9ec9cb29f817 tempest-VolumesGetTest-374048226 None] Deleted volume successfully.
Sep 28 18:19:22 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4594be7a-b6e8-4244-9440-252941ab923a 1073741824" returned: 0 in 0.849s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0f6dbe12-2325-4e41-90b4-9ec9cb29f817 tempest-VolumesGetTest-374048226 None] Lock "cinder-bad07f90-d990-4266-9006-cdf75bef62a0-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-34f5d852-3dda-4379-ac56-24505c0cb238 tempest-VolumesGetTest-374048226 None] Acquiring lock "cinder-b15b13cf-2b4d-46d0-b66a-842aad5a2659-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4594be7a-b6e8-4244-9440-252941ab923a {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-34f5d852-3dda-4379-ac56-24505c0cb238 tempest-VolumesGetTest-374048226 None] Lock "cinder-b15b13cf-2b4d-46d0-b66a-842aad5a2659-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:19:22 devstack sudo[101093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4594be7a-b6e8-4244-9440-252941ab923a
Sep 28 18:19:22 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-34f5d852-3dda-4379-ac56-24505c0cb238 tempest-VolumesGetTest-374048226 None] Acquiring lock "cinder-quobyte-b15b13cf-2b4d-46d0-b66a-842aad5a2659" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-34f5d852-3dda-4379-ac56-24505c0cb238 tempest-VolumesGetTest-374048226 None] Lock "cinder-quobyte-b15b13cf-2b4d-46d0-b66a-842aad5a2659" acquired by "delete_volume" :: waited 0.038s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ded366-9aa0-4f35-9305-8e3578b8df0a]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-34f5d852-3dda-4379-ac56-24505c0cb238 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b15b13cf-2b4d-46d0-b66a-842aad5a2659 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:22 devstack sudo[101095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b15b13cf-2b4d-46d0-b66a-842aad5a2659
Sep 28 18:19:22 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:22 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800eda99-9328-4afb-817c-b798ce585520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5ff682bb-d526-40ce-ab25-afb0e4f1f871', 'volume_name': 'volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871', 'volume_size': 1, 'image_id': '69117e5e-2287-4f6b-8bd1-edaab175325a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69117e5e-2287-4f6b-8bd1-edaab175325a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--324088565', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ebf4158c3f6498eabd8d95c624a8dfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '69117e5e-2287-4f6b-8bd1-edaab175325a', 'created_at': datetime.datetime(2026, 9, 28, 16, 19, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 19, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69117e5e-2287-4f6b-8bd1-edaab175325a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aaede34d0>}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef76beea-b587-4619-867d-a0f48cbac1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef76beea-b587-4619-867d-a0f48cbac1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (254c9183-99d5-41d8-a496-c77993dbf5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:22 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Volume 5ff682bb-d526-40ce-ab25-afb0e4f1f871: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871', 'volume_size': 1, 'image_id': '69117e5e-2287-4f6b-8bd1-edaab175325a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69117e5e-2287-4f6b-8bd1-edaab175325a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--324088565', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ebf4158c3f6498eabd8d95c624a8dfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '69117e5e-2287-4f6b-8bd1-edaab175325a', 'created_at': datetime.datetime(2026, 9, 28, 16, 19, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 19, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69117e5e-2287-4f6b-8bd1-edaab175325a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aaede34d0>}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Trying to clone 5ff682bb-d526-40ce-ab25-afb0e4f1f871 from image 69117e5e-2287-4f6b-8bd1-edaab175325a at location (None, [{'url': 'file:///opt/stack/data/glance/images/69117e5e-2287-4f6b-8bd1-edaab175325a', 'metadata': {}}]). {{(pid=87046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4594be7a-b6e8-4244-9440-252941ab923a" returned: 0 in 0.404s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9208a481-3b7a-4a9b-85e3-1dd5e1d9091b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4594be7a-b6e8-4244-9440-252941ab923a', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d4a4f2-2440-4eff-8f32-a53a273999d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:23 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Volume volume-4594be7a-b6e8-4244-9440-252941ab923a (4594be7a-b6e8-4244-9440-252941ab923a): created successfully
Sep 28 18:19:23 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d4a4f2-2440-4eff-8f32-a53a273999d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:23 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Flow 'volume_create_manager' (773ab52f-e5a2-4dd0-b524-206741d4c346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:23 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-a103001c-7494-4087-bff3-e87f92ad9a1e tempest-TestInstancesWithCinderVolumes-992173720 None] Created volume successfully.
Sep 28 18:19:23 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-34f5d852-3dda-4379-ac56-24505c0cb238 tempest-VolumesGetTest-374048226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b15b13cf-2b4d-46d0-b66a-842aad5a2659" returned: 0 in 0.534s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-34f5d852-3dda-4379-ac56-24505c0cb238 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b15b13cf-2b4d-46d0-b66a-842aad5a2659 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:23 devstack sudo[101103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b15b13cf-2b4d-46d0-b66a-842aad5a2659
Sep 28 18:19:23 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:23 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-34f5d852-3dda-4379-ac56-24505c0cb238 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b15b13cf-2b4d-46d0-b66a-842aad5a2659" returned: 0 in 0.288s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-34f5d852-3dda-4379-ac56-24505c0cb238 tempest-VolumesGetTest-374048226 None] Lock "cinder-quobyte-b15b13cf-2b4d-46d0-b66a-842aad5a2659" released by "delete_volume" :: held 0.886s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:19:23 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-34f5d852-3dda-4379-ac56-24505c0cb238 tempest-VolumesGetTest-374048226 None] Created reservations ['e00f2673-cac0-483c-9d0f-bb4029978796', '3fae4a68-5068-4cd1-b6a9-d67471fff712', 'bfefc9a7-3ea6-4249-bbb2-5c335bb36481', '6743ac23-719b-411c-baa0-47015afeedfb'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:19:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-34f5d852-3dda-4379-ac56-24505c0cb238 tempest-VolumesGetTest-374048226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-34f5d852-3dda-4379-ac56-24505c0cb238 tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:23 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-34f5d852-3dda-4379-ac56-24505c0cb238 tempest-VolumesGetTest-374048226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:19:23 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-34f5d852-3dda-4379-ac56-24505c0cb238 tempest-VolumesGetTest-374048226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:19:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-34f5d852-3dda-4379-ac56-24505c0cb238 tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-34f5d852-3dda-4379-ac56-24505c0cb238 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:23 devstack sudo[101106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:19:23 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:24 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-34f5d852-3dda-4379-ac56-24505c0cb238 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.357s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:24 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-34f5d852-3dda-4379-ac56-24505c0cb238 tempest-VolumesGetTest-374048226 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:19:24 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-34f5d852-3dda-4379-ac56-24505c0cb238 tempest-VolumesGetTest-374048226 None] Deleted volume successfully.
Sep 28 18:19:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-34f5d852-3dda-4379-ac56-24505c0cb238 tempest-VolumesGetTest-374048226 None] Lock "cinder-b15b13cf-2b4d-46d0-b66a-842aad5a2659-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:19:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ed6a89b9-60a6-4312-ab69-faecc084582b tempest-VolumesGetTest-374048226 None] Acquiring lock "cinder-2fe52070-8503-4c6c-9b25-ad178a362602-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:19:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ed6a89b9-60a6-4312-ab69-faecc084582b tempest-VolumesGetTest-374048226 None] Lock "cinder-2fe52070-8503-4c6c-9b25-ad178a362602-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:19:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ed6a89b9-60a6-4312-ab69-faecc084582b tempest-VolumesGetTest-374048226 None] Acquiring lock "cinder-quobyte-2fe52070-8503-4c6c-9b25-ad178a362602" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:19:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ed6a89b9-60a6-4312-ab69-faecc084582b tempest-VolumesGetTest-374048226 None] Lock "cinder-quobyte-2fe52070-8503-4c6c-9b25-ad178a362602" acquired by "delete_volume" :: waited 0.021s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:19:25 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aedc244-9527-4c86-91ab-1b6c3f9e95a3]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:19:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ed6a89b9-60a6-4312-ab69-faecc084582b tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:25 devstack sudo[101110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602
Sep 28 18:19:25 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:25 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ed6a89b9-60a6-4312-ab69-faecc084582b tempest-VolumesGetTest-374048226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602" returned: 0 in 0.457s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ed6a89b9-60a6-4312-ab69-faecc084582b tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:25 devstack sudo[101116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602
Sep 28 18:19:25 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:25 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ed6a89b9-60a6-4312-ab69-faecc084582b tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fe52070-8503-4c6c-9b25-ad178a362602" returned: 0 in 0.355s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ed6a89b9-60a6-4312-ab69-faecc084582b tempest-VolumesGetTest-374048226 None] Lock "cinder-quobyte-2fe52070-8503-4c6c-9b25-ad178a362602" released by "delete_volume" :: held 0.899s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:19:26 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-ed6a89b9-60a6-4312-ab69-faecc084582b tempest-VolumesGetTest-374048226 None] Created reservations ['77e93faf-3e77-40bb-946b-cc6afc8ce658', '0a2cc279-d4c1-4544-bf80-ae78c843e161', 'e63a1af3-7922-4c80-b193-595525a31001', '1c8c0d07-8663-498c-b8ce-a720d3348464'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:19:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ed6a89b9-60a6-4312-ab69-faecc084582b tempest-VolumesGetTest-374048226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ed6a89b9-60a6-4312-ab69-faecc084582b tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ed6a89b9-60a6-4312-ab69-faecc084582b tempest-VolumesGetTest-374048226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:19:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ed6a89b9-60a6-4312-ab69-faecc084582b tempest-VolumesGetTest-374048226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:19:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ed6a89b9-60a6-4312-ab69-faecc084582b tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ed6a89b9-60a6-4312-ab69-faecc084582b tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:26 devstack sudo[101119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:19:26 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:26 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ed6a89b9-60a6-4312-ab69-faecc084582b tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.319s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:26 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-ed6a89b9-60a6-4312-ab69-faecc084582b tempest-VolumesGetTest-374048226 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:19:26 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-ed6a89b9-60a6-4312-ab69-faecc084582b tempest-VolumesGetTest-374048226 None] Deleted volume successfully.
Sep 28 18:19:26 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ed6a89b9-60a6-4312-ab69-faecc084582b tempest-VolumesGetTest-374048226 None] Lock "cinder-2fe52070-8503-4c6c-9b25-ad178a362602-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:19:27 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:19:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Flow 'volume_create_manager' (33c0c659-cd23-4c06-8cff-8eb45e1f4395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d8c1ef7-68a4-41d7-a5c4-64dbdf42b71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d8c1ef7-68a4-41d7-a5c4-64dbdf42b71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1513370276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca9a8c9-2c77-4d21-b1af-42435070a3fa,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94b02642c5af4545836c283fc55b2409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:27Z,use_quota=True,user_id='825254fe29324576a8a7855a200e4b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d935e957-80a8-4b90-ac22-d66d2e29d601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d935e957-80a8-4b90-ac22-d66d2e29d601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b13d55-667e-44a7-81f9-b0dff05c7570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:27 devstack cinder-volume[87046]: DEBUG cinder.image.glance [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Creating Keystone auth plugin from conf {{(pid=87046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 28 18:19:27 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_69117e5e-2287-4f6b-8bd1-edaab175325a_m68s3__hdevstack@QuobyteHD, size 20.69 MB, duration 4.70 sec {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 28 18:19:27 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Image download 20.69 MB at 4.40 MB/s
Sep 28 18:19:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b13d55-667e-44a7-81f9-b0dff05c7570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7ca9a8c9-2c77-4d21-b1af-42435070a3fa', 'volume_name': 'volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa', 'volume_size': 1, 'image_id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de2452cfca174dfbbc7b50b163b23faa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'created_at': datetime.datetime(2026, 9, 28, 15, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 58, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aaed3a750>}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fddf58fe-ddbb-4d4e-be9b-a03a8df1233e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fddf58fe-ddbb-4d4e-be9b-a03a8df1233e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d7b2dfc-e6de-437b-a7b9-778c38c4de8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:27 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Volume 7ca9a8c9-2c77-4d21-b1af-42435070a3fa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa', 'volume_size': 1, 'image_id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de2452cfca174dfbbc7b50b163b23faa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'created_at': datetime.datetime(2026, 9, 28, 15, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 58, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aaed3a750>}
Sep 28 18:19:27 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Trying to clone 7ca9a8c9-2c77-4d21-b1af-42435070a3fa from image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}]). {{(pid=87046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 28 18:19:27 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e428d9fa-02af-41a8-abb1-4f865e3cc0be]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:19:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69117e5e-2287-4f6b-8bd1-edaab175325a_m68s3__hdevstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:27 devstack sudo[101122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69117e5e-2287-4f6b-8bd1-edaab175325a_m68s3__hdevstack@QuobyteHD
Sep 28 18:19:27 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:27 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Flow 'volume_create_manager' (b94b378d-7237-4233-b60b-883a4d6addfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9002753-26c7-422d-a89e-aaa44cf14ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9002753-26c7-422d-a89e-aaa44cf14ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2144581200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202fe0bb-ae67-4b97-bb98-608b84c90fcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5786a7894a3f4688b1fac92dc8e01a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:28Z,use_quota=True,user_id='b7a2111e47de4fcea1640c4848f4c114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e21bdc-6897-442a-a1ed-fa643217ef92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e21bdc-6897-442a-a1ed-fa643217ef92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2ef708-f535-4bf7-ab03-415adf93ee64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2ef708-f535-4bf7-ab03-415adf93ee64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '202fe0bb-ae67-4b97-bb98-608b84c90fcc', 'volume_name': 'volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec8b74c-d8be-4898-a212-f94f0736ce45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec8b74c-d8be-4898-a212-f94f0736ce45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e660ec-ac44-4a34-8683-f87efbe55890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:28 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Volume 202fe0bb-ae67-4b97-bb98-608b84c90fcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc', 'volume_size': 1}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2144581200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202fe0bb-ae67-4b97-bb98-608b84c90fcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5786a7894a3f4688b1fac92dc8e01a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:28Z,use_quota=True,user_id='b7a2111e47de4fcea1640c4848f4c114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Creating volume 202fe0bb-ae67-4b97-bb98-608b84c90fcc {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:19:28 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:28 devstack sudo[101159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc 1073741824
Sep 28 18:19:28 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:28 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69117e5e-2287-4f6b-8bd1-edaab175325a_m68s3__hdevstack@QuobyteHD" returned: 0 in 0.595s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Temporary image 69117e5e-2287-4f6b-8bd1-edaab175325a is fetched for user 74b7cc5c29af48c887ae78c9a0e9f31c. {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_yx3e3e4ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 28 18:19:28 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Image download 20.69 MB at 20.69 MB/s
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[33725f45-aaa8-4e8e-a25f-aa90527b6930]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_yx3e3e4ldevstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[23da37a1-a039-4186-bb17-e6ae7eea3abc]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69117e5e-2287-4f6b-8bd1-edaab175325a_m68s3__hdevstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:28 devstack sudo[101167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_yx3e3e4ldevstack@QuobyteHD
Sep 28 18:19:28 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:28 devstack sudo[101168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69117e5e-2287-4f6b-8bd1-edaab175325a_m68s3__hdevstack@QuobyteHD
Sep 28 18:19:28 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:28 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc 1073741824" returned: 0 in 0.686s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:28 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_yx3e3e4ldevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Temporary image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 is fetched for user 825254fe29324576a8a7855a200e4b55. {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:28 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:28 devstack sudo[101181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc
Sep 28 18:19:28 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69117e5e-2287-4f6b-8bd1-edaab175325a_m68s3__hdevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f21e2f-c8a0-49c7-84e3-4e648966f390]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_yx3e3e4ldevstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:29 devstack sudo[101183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_yx3e3e4ldevstack@QuobyteHD
Sep 28 18:19:29 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:29 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc" returned: 0 in 0.336s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.304s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1257883957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff682bb-d526-40ce-ab25-afb0e4f1f871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebf4158c3f6498eabd8d95c624a8dfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:22Z,use_quota=True,user_id='74b7cc5c29af48c887ae78c9a0e9f31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f10b6631-0516-4903-981d-b0f46c776162),volume_type_id=f10b6631-0516-4903-981d-b0f46c776162)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Creating volume 5ff682bb-d526-40ce-ab25-afb0e4f1f871 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:19:29 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e660ec-ac44-4a34-8683-f87efbe55890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c233f3-c938-4f11-b0d2-1790718f8c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:29 devstack sudo[101186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871 1073741824
Sep 28 18:19:29 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:29 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Volume volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc (202fe0bb-ae67-4b97-bb98-608b84c90fcc): created successfully
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c233f3-c938-4f11-b0d2-1790718f8c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Flow 'volume_create_manager' (b94b378d-7237-4233-b60b-883a4d6addfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:29 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-72391381-816e-49fe-9e71-8f764fa048e5 tempest-SnapshotMetadataTestJSON-500589126 None] Created volume successfully.
Sep 28 18:19:29 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_yx3e3e4ldevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:29 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871 1073741824" returned: 0 in 0.476s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:29 devstack sudo[101195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871
Sep 28 18:19:29 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:30 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871" returned: 0 in 0.336s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:19:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.751s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1513370276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca9a8c9-2c77-4d21-b1af-42435070a3fa,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94b02642c5af4545836c283fc55b2409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:27Z,use_quota=True,user_id='825254fe29324576a8a7855a200e4b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:19:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Creating volume 7ca9a8c9-2c77-4d21-b1af-42435070a3fa {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:19:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:19:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:19:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:19:30 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:19:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:30 devstack sudo[101198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa 1073741824
Sep 28 18:19:30 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:30 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Attempting download of 69117e5e-2287-4f6b-8bd1-edaab175325a ((None, [{'url': 'file:///opt/stack/data/glance/images/69117e5e-2287-4f6b-8bd1-edaab175325a', 'metadata': {}}])) to volume 5ff682bb-d526-40ce-ab25-afb0e4f1f871. {{(pid=87046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 28 18:19:30 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[87402b8d-ea9d-4d2f-973d-fd152b030cf6]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:19:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69117e5e-2287-4f6b-8bd1-edaab175325a_d715pg_l {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-aa303d90-30e2-4dfc-bb60-6d1d7aabb365 tempest-SnapshotMetadataTestJSON-500589126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:30 devstack sudo[101200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69117e5e-2287-4f6b-8bd1-edaab175325a_d715pg_l
Sep 28 18:19:30 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:30 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa 1073741824" returned: 0 in 0.512s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:30 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69117e5e-2287-4f6b-8bd1-edaab175325a_d715pg_l" returned: 0 in 0.445s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69117e5e-2287-4f6b-8bd1-edaab175325a_d715pg_l {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:30 devstack sudo[101207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa
Sep 28 18:19:30 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:30 devstack sudo[101208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69117e5e-2287-4f6b-8bd1-edaab175325a_d715pg_l
Sep 28 18:19:30 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:31 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa" returned: 0 in 0.288s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:31 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:19:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-aa303d90-30e2-4dfc-bb60-6d1d7aabb365 tempest-SnapshotMetadataTestJSON-500589126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.624s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:31 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-aa303d90-30e2-4dfc-bb60-6d1d7aabb365 tempest-SnapshotMetadataTestJSON-500589126 None] Creating offline snapshot bee4a6e8-c026-489e-bdf2-7250e5964bc7 of volume 202fe0bb-ae67-4b97-bb98-608b84c90fcc {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:19:31 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Attempting download of c5b6ff95-792c-4fb0-b8e7-dea90bc76834 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}])) to volume 7ca9a8c9-2c77-4d21-b1af-42435070a3fa. {{(pid=87046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 28 18:19:31 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[206055ef-ac1c-471f-987c-460f10c41214]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:19:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aa303d90-30e2-4dfc-bb60-6d1d7aabb365 tempest-SnapshotMetadataTestJSON-500589126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:31 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[184f86aa-33c4-43ac-8e7f-0d9e88b7dfa6]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:19:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_xp9990lb {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:31 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69117e5e-2287-4f6b-8bd1-edaab175325a_d715pg_l" returned: 1 in 0.411s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69117e5e-2287-4f6b-8bd1-edaab175325a_d715pg_l' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:19:31 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a90426-1580-4c29-8de1-78bd59a81033]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:19:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69117e5e-2287-4f6b-8bd1-edaab175325a_m68s3__hdevstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:31 devstack sudo[101212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc
Sep 28 18:19:31 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:31 devstack sudo[101215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_xp9990lb
Sep 28 18:19:31 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:31 devstack sudo[101216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69117e5e-2287-4f6b-8bd1-edaab175325a_m68s3__hdevstack@QuobyteHD
Sep 28 18:19:31 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:31 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aa303d90-30e2-4dfc-bb60-6d1d7aabb365 tempest-SnapshotMetadataTestJSON-500589126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc" returned: 0 in 0.469s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aa303d90-30e2-4dfc-bb60-6d1d7aabb365 tempest-SnapshotMetadataTestJSON-500589126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.bee4a6e8-c026-489e-bdf2-7250e5964bc7 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:31 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_xp9990lb" returned: 0 in 0.416s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_xp9990lb {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:31 devstack sudo[101225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.bee4a6e8-c026-489e-bdf2-7250e5964bc7 1G
Sep 28 18:19:31 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:31 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69117e5e-2287-4f6b-8bd1-edaab175325a_m68s3__hdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:31 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] 69117e5e-2287-4f6b-8bd1-edaab175325a was qcow2, converting to qcow2 {{(pid=87046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 28 18:19:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_69117e5e-2287-4f6b-8bd1-edaab175325a_m68s3__hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:31 devstack sudo[101231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_69117e5e-2287-4f6b-8bd1-edaab175325a_m68s3__hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871
Sep 28 18:19:31 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:31 devstack sudo[101226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_xp9990lb
Sep 28 18:19:31 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:32 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_xp9990lb" returned: 1 in 0.463s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_xp9990lb' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:19:32 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c419c06d-9934-4d7b-8fd8-db1135f4ce87]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:19:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_yx3e3e4ldevstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:32 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aa303d90-30e2-4dfc-bb60-6d1d7aabb365 tempest-SnapshotMetadataTestJSON-500589126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.bee4a6e8-c026-489e-bdf2-7250e5964bc7 1G" returned: 0 in 0.508s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aa303d90-30e2-4dfc-bb60-6d1d7aabb365 tempest-SnapshotMetadataTestJSON-500589126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.bee4a6e8-c026-489e-bdf2-7250e5964bc7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:32 devstack sudo[101244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.bee4a6e8-c026-489e-bdf2-7250e5964bc7
Sep 28 18:19:32 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:32 devstack sudo[101243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_yx3e3e4ldevstack@QuobyteHD
Sep 28 18:19:32 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:32 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_yx3e3e4ldevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:32 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] c5b6ff95-792c-4fb0-b8e7-dea90bc76834 was qcow2, converting to qcow2 {{(pid=87046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 28 18:19:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_yx3e3e4ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:32 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aa303d90-30e2-4dfc-bb60-6d1d7aabb365 tempest-SnapshotMetadataTestJSON-500589126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.bee4a6e8-c026-489e-bdf2-7250e5964bc7" returned: 0 in 0.418s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:32 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-aa303d90-30e2-4dfc-bb60-6d1d7aabb365 tempest-SnapshotMetadataTestJSON-500589126 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.bee4a6e8-c026-489e-bdf2-7250e5964bc7 is being set with open permissions: ugo+rw
Sep 28 18:19:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aa303d90-30e2-4dfc-bb60-6d1d7aabb365 tempest-SnapshotMetadataTestJSON-500589126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.bee4a6e8-c026-489e-bdf2-7250e5964bc7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:32 devstack sudo[101254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_yx3e3e4ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa
Sep 28 18:19:32 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:32 devstack sudo[101256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.bee4a6e8-c026-489e-bdf2-7250e5964bc7
Sep 28 18:19:32 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:32 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aa303d90-30e2-4dfc-bb60-6d1d7aabb365 tempest-SnapshotMetadataTestJSON-500589126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.bee4a6e8-c026-489e-bdf2-7250e5964bc7" returned: 0 in 0.379s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aa303d90-30e2-4dfc-bb60-6d1d7aabb365 tempest-SnapshotMetadataTestJSON-500589126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:32 devstack sudo[101263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.info
Sep 28 18:19:32 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:33 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aa303d90-30e2-4dfc-bb60-6d1d7aabb365 tempest-SnapshotMetadataTestJSON-500589126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.info" returned: 0 in 0.342s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:33 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-aa303d90-30e2-4dfc-bb60-6d1d7aabb365 tempest-SnapshotMetadataTestJSON-500589126 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.info is being set with open permissions: ugo+rw
Sep 28 18:19:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aa303d90-30e2-4dfc-bb60-6d1d7aabb365 tempest-SnapshotMetadataTestJSON-500589126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:33 devstack sudo[101274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.info
Sep 28 18:19:33 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:33 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aa303d90-30e2-4dfc-bb60-6d1d7aabb365 tempest-SnapshotMetadataTestJSON-500589126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.info" returned: 0 in 0.312s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-aa303d90-30e2-4dfc-bb60-6d1d7aabb365 tempest-SnapshotMetadataTestJSON-500589126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.566s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:33 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-aa303d90-30e2-4dfc-bb60-6d1d7aabb365 tempest-SnapshotMetadataTestJSON-500589126 None] Create snapshot completed successfully
Sep 28 18:19:33 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_69117e5e-2287-4f6b-8bd1-edaab175325a_m68s3__hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871" returned: 0 in 2.354s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:33 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_69117e5e-2287-4f6b-8bd1-edaab175325a_m68s3__hdevstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871 {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:19:33 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Converted 112.00 MB image at 47.54 MB/s
Sep 28 18:19:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:34 devstack sudo[101278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871 1G
Sep 28 18:19:34 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:34 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871 1G" returned: 0 in 0.411s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:34 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Downloaded image 69117e5e-2287-4f6b-8bd1-edaab175325a ((None, [{'url': 'file:///opt/stack/data/glance/images/69117e5e-2287-4f6b-8bd1-edaab175325a', 'metadata': {}}])) to volume 5ff682bb-d526-40ce-ab25-afb0e4f1f871 successfully. {{(pid=87046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 28 18:19:34 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Temporary image 69117e5e-2287-4f6b-8bd1-edaab175325a for user 74b7cc5c29af48c887ae78c9a0e9f31c is deleted. {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 28 18:19:34 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Marking volume 5ff682bb-d526-40ce-ab25-afb0e4f1f871 as bootable. {{(pid=87046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 28 18:19:34 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Copying metadata from image 69117e5e-2287-4f6b-8bd1-edaab175325a to 5ff682bb-d526-40ce-ab25-afb0e4f1f871. {{(pid=87046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 28 18:19:34 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Creating volume glance metadata for volume 5ff682bb-d526-40ce-ab25-afb0e4f1f871 backed by image 69117e5e-2287-4f6b-8bd1-edaab175325a with: {'image_id': '69117e5e-2287-4f6b-8bd1-edaab175325a', 'image_name': 'tempest-scenario-img--324088565', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 28 18:19:34 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (254c9183-99d5-41d8-a496-c77993dbf5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871', 'volume_size': 1, 'image_id': '69117e5e-2287-4f6b-8bd1-edaab175325a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69117e5e-2287-4f6b-8bd1-edaab175325a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--324088565', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ebf4158c3f6498eabd8d95c624a8dfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '69117e5e-2287-4f6b-8bd1-edaab175325a', 'created_at': datetime.datetime(2026, 9, 28, 16, 19, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 19, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69117e5e-2287-4f6b-8bd1-edaab175325a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aaede34d0>}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:34 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71482620-488c-4ba2-a83d-5de254d3c2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:34 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Volume volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871 (5ff682bb-d526-40ce-ab25-afb0e4f1f871): created successfully
Sep 28 18:19:34 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71482620-488c-4ba2-a83d-5de254d3c2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:34 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Flow 'volume_create_manager' (c2f409b2-0463-4f3d-985d-81f06f53ddde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:34 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-74ede3dc-d944-424e-94b8-16267fcdcf47 tempest-TestInstancesWithCinderVolumes-992173720 None] Created volume successfully.
Sep 28 18:19:34 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_yx3e3e4ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa" returned: 0 in 2.465s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:34 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_yx3e3e4ldevstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:19:34 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Converted 112.00 MB image at 45.42 MB/s
Sep 28 18:19:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:34 devstack sudo[101283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa 1G
Sep 28 18:19:34 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:35 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa 1G" returned: 0 in 0.443s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:35 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Downloaded image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}])) to volume 7ca9a8c9-2c77-4d21-b1af-42435070a3fa successfully. {{(pid=87046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 28 18:19:35 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Temporary image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 for user 825254fe29324576a8a7855a200e4b55 is deleted. {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 28 18:19:35 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Marking volume 7ca9a8c9-2c77-4d21-b1af-42435070a3fa as bootable. {{(pid=87046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 28 18:19:35 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Copying metadata from image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 to 7ca9a8c9-2c77-4d21-b1af-42435070a3fa. {{(pid=87046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 28 18:19:35 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Creating volume glance metadata for volume 7ca9a8c9-2c77-4d21-b1af-42435070a3fa backed by image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 28 18:19:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d7b2dfc-e6de-437b-a7b9-778c38c4de8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa', 'volume_size': 1, 'image_id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de2452cfca174dfbbc7b50b163b23faa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'created_at': datetime.datetime(2026, 9, 28, 15, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 58, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aaed3a750>}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176c581f-37a8-4d62-b7d1-535bd8df98e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:35 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Volume volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa (7ca9a8c9-2c77-4d21-b1af-42435070a3fa): created successfully
Sep 28 18:19:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176c581f-37a8-4d62-b7d1-535bd8df98e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Flow 'volume_create_manager' (33c0c659-cd23-4c06-8cff-8eb45e1f4395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ba1042ca-2011-4e27-ba23-8859a4560f33 tempest-SnapshotMetadataTestJSON-500589126 None] Acquiring lock "cinder-bee4a6e8-c026-489e-bdf2-7250e5964bc7-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:19:35 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-dc488f0a-5828-4edf-a146-b4956919cf51 tempest-VolumesGetTest-374048226 None] Created volume successfully.
Sep 28 18:19:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ba1042ca-2011-4e27-ba23-8859a4560f33 tempest-SnapshotMetadataTestJSON-500589126 None] Lock "cinder-bee4a6e8-c026-489e-bdf2-7250e5964bc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:19:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ba1042ca-2011-4e27-ba23-8859a4560f33 tempest-SnapshotMetadataTestJSON-500589126 None] Acquiring lock "cinder-quobyte-202fe0bb-ae67-4b97-bb98-608b84c90fcc" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:19:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ba1042ca-2011-4e27-ba23-8859a4560f33 tempest-SnapshotMetadataTestJSON-500589126 None] Lock "cinder-quobyte-202fe0bb-ae67-4b97-bb98-608b84c90fcc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:19:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ba1042ca-2011-4e27-ba23-8859a4560f33 tempest-SnapshotMetadataTestJSON-500589126 None] Acquiring lock "cinder-quobyte-bee4a6e8-c026-489e-bdf2-7250e5964bc7" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:19:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ba1042ca-2011-4e27-ba23-8859a4560f33 tempest-SnapshotMetadataTestJSON-500589126 None] Lock "cinder-quobyte-bee4a6e8-c026-489e-bdf2-7250e5964bc7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:19:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-ba1042ca-2011-4e27-ba23-8859a4560f33 tempest-SnapshotMetadataTestJSON-500589126 None] Deleting offline snapshot bee4a6e8-c026-489e-bdf2-7250e5964bc7 of volume 202fe0bb-ae67-4b97-bb98-608b84c90fcc {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:19:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-ba1042ca-2011-4e27-ba23-8859a4560f33 tempest-SnapshotMetadataTestJSON-500589126 None] snapshot_file for this snap is: volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.bee4a6e8-c026-489e-bdf2-7250e5964bc7 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:19:35 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b865bfd-d97c-4836-b6df-e41cabd59b12]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:19:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ba1042ca-2011-4e27-ba23-8859a4560f33 tempest-SnapshotMetadataTestJSON-500589126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.bee4a6e8-c026-489e-bdf2-7250e5964bc7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:35 devstack sudo[101289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.bee4a6e8-c026-489e-bdf2-7250e5964bc7
Sep 28 18:19:35 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:36 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ba1042ca-2011-4e27-ba23-8859a4560f33 tempest-SnapshotMetadataTestJSON-500589126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.bee4a6e8-c026-489e-bdf2-7250e5964bc7" returned: 0 in 0.524s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-ba1042ca-2011-4e27-ba23-8859a4560f33 tempest-SnapshotMetadataTestJSON-500589126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:19:36 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb95ba25-a4d0-469a-a855-c86ac763abf5]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:19:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ba1042ca-2011-4e27-ba23-8859a4560f33 tempest-SnapshotMetadataTestJSON-500589126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:36 devstack sudo[101294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc
Sep 28 18:19:36 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:36 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ba1042ca-2011-4e27-ba23-8859a4560f33 tempest-SnapshotMetadataTestJSON-500589126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc" returned: 0 in 0.579s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ba1042ca-2011-4e27-ba23-8859a4560f33 tempest-SnapshotMetadataTestJSON-500589126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.bee4a6e8-c026-489e-bdf2-7250e5964bc7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:36 devstack sudo[101299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.bee4a6e8-c026-489e-bdf2-7250e5964bc7
Sep 28 18:19:36 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:36 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:19:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Flow 'volume_create_manager' (c6270e1d-3cf5-47a1-a976-f38b1239416d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a15839-7df2-453f-bea8-30fa19ab1e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a15839-7df2-453f-bea8-30fa19ab1e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:19:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-194012492',display_name='tempest-VolumesGetTest-Volume-863043854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77f5480-16de-484b-96b1-2cf707af10f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b02642c5af4545836c283fc55b2409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:37Z,use_quota=True,user_id='825254fe29324576a8a7855a200e4b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1893e447-3fbf-4421-b6ea-f61e5c8f2fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1893e447-3fbf-4421-b6ea-f61e5c8f2fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3312743-6344-4303-a973-fcad31af0587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3312743-6344-4303-a973-fcad31af0587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b77f5480-16de-484b-96b1-2cf707af10f1', 'volume_name': 'volume-b77f5480-16de-484b-96b1-2cf707af10f1', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7422323-67ae-42ed-a24f-0f9888649d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7422323-67ae-42ed-a24f-0f9888649d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39369f5-f227-4ed4-8130-5b734f1d8a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:37 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Volume b77f5480-16de-484b-96b1-2cf707af10f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b77f5480-16de-484b-96b1-2cf707af10f1', 'volume_size': 1}
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:19:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-194012492',display_name='tempest-VolumesGetTest-Volume-863043854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77f5480-16de-484b-96b1-2cf707af10f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b02642c5af4545836c283fc55b2409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:37Z,use_quota=True,user_id='825254fe29324576a8a7855a200e4b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Creating volume b77f5480-16de-484b-96b1-2cf707af10f1 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:19:37 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b77f5480-16de-484b-96b1-2cf707af10f1 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:37 devstack sudo[101304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b77f5480-16de-484b-96b1-2cf707af10f1 1073741824
Sep 28 18:19:37 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:37 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ba1042ca-2011-4e27-ba23-8859a4560f33 tempest-SnapshotMetadataTestJSON-500589126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.bee4a6e8-c026-489e-bdf2-7250e5964bc7" returned: 0 in 0.506s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ba1042ca-2011-4e27-ba23-8859a4560f33 tempest-SnapshotMetadataTestJSON-500589126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.bee4a6e8-c026-489e-bdf2-7250e5964bc7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:37 devstack sudo[101315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.bee4a6e8-c026-489e-bdf2-7250e5964bc7
Sep 28 18:19:37 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:37 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b77f5480-16de-484b-96b1-2cf707af10f1 1073741824" returned: 0 in 0.665s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:37 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ba1042ca-2011-4e27-ba23-8859a4560f33 tempest-SnapshotMetadataTestJSON-500589126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc.bee4a6e8-c026-489e-bdf2-7250e5964bc7" returned: 0 in 0.398s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b77f5480-16de-484b-96b1-2cf707af10f1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:37 devstack sudo[101320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b77f5480-16de-484b-96b1-2cf707af10f1
Sep 28 18:19:37 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ba1042ca-2011-4e27-ba23-8859a4560f33 tempest-SnapshotMetadataTestJSON-500589126 None] Lock "cinder-quobyte-bee4a6e8-c026-489e-bdf2-7250e5964bc7" released by "_delete_snapshot" :: held 2.207s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ba1042ca-2011-4e27-ba23-8859a4560f33 tempest-SnapshotMetadataTestJSON-500589126 None] Lock "cinder-quobyte-202fe0bb-ae67-4b97-bb98-608b84c90fcc" released by "delete_snapshot" :: held 2.243s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:19:37 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-ba1042ca-2011-4e27-ba23-8859a4560f33 tempest-SnapshotMetadataTestJSON-500589126 None] Created reservations ['f8978868-a17a-4891-b4f8-c3002b1ed01b', 'f5d3edf6-4b3d-484d-90a8-63b10f3e408f', '8d4843f8-2799-41bf-834b-8a916def303c', 'a43b4fd5-7c0a-4110-9d14-4a616ea79b6c'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:19:38 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-ba1042ca-2011-4e27-ba23-8859a4560f33 tempest-SnapshotMetadataTestJSON-500589126 None] Delete snapshot completed successfully.
Sep 28 18:19:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ba1042ca-2011-4e27-ba23-8859a4560f33 tempest-SnapshotMetadataTestJSON-500589126 None] Lock "cinder-bee4a6e8-c026-489e-bdf2-7250e5964bc7-delete_snapshot" released by "delete_snapshot" :: held 2.450s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:19:38 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b77f5480-16de-484b-96b1-2cf707af10f1" returned: 0 in 0.313s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:38 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:19:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39369f5-f227-4ed4-8130-5b734f1d8a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b77f5480-16de-484b-96b1-2cf707af10f1', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c91c71-8497-47ef-862e-3d4695fe2401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:38 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Volume volume-b77f5480-16de-484b-96b1-2cf707af10f1 (b77f5480-16de-484b-96b1-2cf707af10f1): created successfully
Sep 28 18:19:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c91c71-8497-47ef-862e-3d4695fe2401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Flow 'volume_create_manager' (c6270e1d-3cf5-47a1-a976-f38b1239416d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:38 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-b245b6f9-b7e7-4bca-84ca-94459a5896e3 tempest-VolumesGetTest-374048226 None] Created volume successfully.
Sep 28 18:19:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-abd14c30-c9b7-481f-b3ff-d82c9d6f66a7 tempest-SnapshotMetadataTestJSON-500589126 None] Acquiring lock "cinder-202fe0bb-ae67-4b97-bb98-608b84c90fcc-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:19:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-abd14c30-c9b7-481f-b3ff-d82c9d6f66a7 tempest-SnapshotMetadataTestJSON-500589126 None] Lock "cinder-202fe0bb-ae67-4b97-bb98-608b84c90fcc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-0e539bd3-cbd4-480a-9dc7-362a282ec335 req-dc7f5087-35e5-4252-a2d7-13c345c3a8b8 tempest-TestInstancesWithCinderVolumes-992173720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-0e539bd3-cbd4-480a-9dc7-362a282ec335 req-dc7f5087-35e5-4252-a2d7-13c345c3a8b8 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-abd14c30-c9b7-481f-b3ff-d82c9d6f66a7 tempest-SnapshotMetadataTestJSON-500589126 None] Acquiring lock "cinder-quobyte-202fe0bb-ae67-4b97-bb98-608b84c90fcc" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-0e539bd3-cbd4-480a-9dc7-362a282ec335 req-dc7f5087-35e5-4252-a2d7-13c345c3a8b8 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-abd14c30-c9b7-481f-b3ff-d82c9d6f66a7 tempest-SnapshotMetadataTestJSON-500589126 None] Lock "cinder-quobyte-202fe0bb-ae67-4b97-bb98-608b84c90fcc" acquired by "delete_volume" :: waited 0.029s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7494fcdb-12a8-481c-9497-8faf52e82b35]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-abd14c30-c9b7-481f-b3ff-d82c9d6f66a7 tempest-SnapshotMetadataTestJSON-500589126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-0e539bd3-cbd4-480a-9dc7-362a282ec335 req-dc7f5087-35e5-4252-a2d7-13c345c3a8b8 tempest-TestInstancesWithCinderVolumes-992173720 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d52c1c0-b608-45ef-9e74-5a47a82fc1bd', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:19:39 devstack sudo[101331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc
Sep 28 18:19:39 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:39 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-0e539bd3-cbd4-480a-9dc7-362a282ec335 req-dc7f5087-35e5-4252-a2d7-13c345c3a8b8 tempest-TestInstancesWithCinderVolumes-992173720 None] attachment_update completed successfully.
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-425219f8-a719-4afc-afce-c339e3da4880 tempest-VolumesGetTest-374048226 None] Acquiring lock "cinder-b77f5480-16de-484b-96b1-2cf707af10f1-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-425219f8-a719-4afc-afce-c339e3da4880 tempest-VolumesGetTest-374048226 None] Lock "cinder-b77f5480-16de-484b-96b1-2cf707af10f1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-425219f8-a719-4afc-afce-c339e3da4880 tempest-VolumesGetTest-374048226 None] Acquiring lock "cinder-quobyte-b77f5480-16de-484b-96b1-2cf707af10f1" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:19:39 devstack sudo[101333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-425219f8-a719-4afc-afce-c339e3da4880 tempest-VolumesGetTest-374048226 None] Lock "cinder-quobyte-b77f5480-16de-484b-96b1-2cf707af10f1" acquired by "delete_volume" :: waited 0.032s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:19:39 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f2fa92-8ea2-4ba2-b3a9-315b69d5e3fe]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-425219f8-a719-4afc-afce-c339e3da4880 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b77f5480-16de-484b-96b1-2cf707af10f1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:39 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-abd14c30-c9b7-481f-b3ff-d82c9d6f66a7 tempest-SnapshotMetadataTestJSON-500589126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc" returned: 0 in 0.686s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-abd14c30-c9b7-481f-b3ff-d82c9d6f66a7 tempest-SnapshotMetadataTestJSON-500589126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:39 devstack sudo[101335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b77f5480-16de-484b-96b1-2cf707af10f1
Sep 28 18:19:39 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:39 devstack sudo[101339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc
Sep 28 18:19:39 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:40 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.593s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:19:40 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-425219f8-a719-4afc-afce-c339e3da4880 tempest-VolumesGetTest-374048226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b77f5480-16de-484b-96b1-2cf707af10f1" returned: 0 in 0.737s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-425219f8-a719-4afc-afce-c339e3da4880 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b77f5480-16de-484b-96b1-2cf707af10f1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:40 devstack sudo[101347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b77f5480-16de-484b-96b1-2cf707af10f1
Sep 28 18:19:40 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:40 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-abd14c30-c9b7-481f-b3ff-d82c9d6f66a7 tempest-SnapshotMetadataTestJSON-500589126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-202fe0bb-ae67-4b97-bb98-608b84c90fcc" returned: 0 in 0.483s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-abd14c30-c9b7-481f-b3ff-d82c9d6f66a7 tempest-SnapshotMetadataTestJSON-500589126 None] Lock "cinder-quobyte-202fe0bb-ae67-4b97-bb98-608b84c90fcc" released by "delete_volume" :: held 1.281s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-abd14c30-c9b7-481f-b3ff-d82c9d6f66a7 tempest-SnapshotMetadataTestJSON-500589126 None] Created reservations ['00432d6c-4515-47da-9375-c976f505f0aa', '0e9edb1d-838e-463e-9682-40e3d5554c0a', 'c80f9e19-97df-44cc-97b8-2eda4da01bb9', '41de0004-50ae-4120-843e-d7fc43c58358'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-abd14c30-c9b7-481f-b3ff-d82c9d6f66a7 tempest-SnapshotMetadataTestJSON-500589126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-abd14c30-c9b7-481f-b3ff-d82c9d6f66a7 tempest-SnapshotMetadataTestJSON-500589126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-abd14c30-c9b7-481f-b3ff-d82c9d6f66a7 tempest-SnapshotMetadataTestJSON-500589126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-abd14c30-c9b7-481f-b3ff-d82c9d6f66a7 tempest-SnapshotMetadataTestJSON-500589126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-abd14c30-c9b7-481f-b3ff-d82c9d6f66a7 tempest-SnapshotMetadataTestJSON-500589126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-abd14c30-c9b7-481f-b3ff-d82c9d6f66a7 tempest-SnapshotMetadataTestJSON-500589126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:40 devstack sudo[101349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:19:40 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:40 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-425219f8-a719-4afc-afce-c339e3da4880 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b77f5480-16de-484b-96b1-2cf707af10f1" returned: 0 in 0.354s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-425219f8-a719-4afc-afce-c339e3da4880 tempest-VolumesGetTest-374048226 None] Lock "cinder-quobyte-b77f5480-16de-484b-96b1-2cf707af10f1" released by "delete_volume" :: held 1.166s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-425219f8-a719-4afc-afce-c339e3da4880 tempest-VolumesGetTest-374048226 None] Created reservations ['c7c33a8a-69c5-4233-b2b6-aaa7d2e268ed', 'b0dcdf98-3645-40f2-9274-b54a20b4da10', '27d9228d-d205-498c-92c8-e5fb9153caa0', '807706b1-6f9c-47f3-b50f-628c28a0c726'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:19:40 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-abd14c30-c9b7-481f-b3ff-d82c9d6f66a7 tempest-SnapshotMetadataTestJSON-500589126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.312s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-abd14c30-c9b7-481f-b3ff-d82c9d6f66a7 tempest-SnapshotMetadataTestJSON-500589126 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:19:40 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-abd14c30-c9b7-481f-b3ff-d82c9d6f66a7 tempest-SnapshotMetadataTestJSON-500589126 None] Deleted volume successfully.
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-425219f8-a719-4afc-afce-c339e3da4880 tempest-VolumesGetTest-374048226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-425219f8-a719-4afc-afce-c339e3da4880 tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-425219f8-a719-4afc-afce-c339e3da4880 tempest-VolumesGetTest-374048226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-425219f8-a719-4afc-afce-c339e3da4880 tempest-VolumesGetTest-374048226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-425219f8-a719-4afc-afce-c339e3da4880 tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-425219f8-a719-4afc-afce-c339e3da4880 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-abd14c30-c9b7-481f-b3ff-d82c9d6f66a7 tempest-SnapshotMetadataTestJSON-500589126 None] Lock "cinder-202fe0bb-ae67-4b97-bb98-608b84c90fcc-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:19:40 devstack sudo[101353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:19:40 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:41 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-425219f8-a719-4afc-afce-c339e3da4880 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.283s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:41 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-425219f8-a719-4afc-afce-c339e3da4880 tempest-VolumesGetTest-374048226 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:19:41 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-425219f8-a719-4afc-afce-c339e3da4880 tempest-VolumesGetTest-374048226 None] Deleted volume successfully.
Sep 28 18:19:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-425219f8-a719-4afc-afce-c339e3da4880 tempest-VolumesGetTest-374048226 None] Lock "cinder-b77f5480-16de-484b-96b1-2cf707af10f1-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:19:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-68e1e0d2-dbb8-496a-8fb7-f56f8167ba53 tempest-VolumesGetTest-374048226 None] Acquiring lock "cinder-7ca9a8c9-2c77-4d21-b1af-42435070a3fa-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:19:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-68e1e0d2-dbb8-496a-8fb7-f56f8167ba53 tempest-VolumesGetTest-374048226 None] Lock "cinder-7ca9a8c9-2c77-4d21-b1af-42435070a3fa-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:19:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-68e1e0d2-dbb8-496a-8fb7-f56f8167ba53 tempest-VolumesGetTest-374048226 None] Acquiring lock "cinder-quobyte-7ca9a8c9-2c77-4d21-b1af-42435070a3fa" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:19:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-68e1e0d2-dbb8-496a-8fb7-f56f8167ba53 tempest-VolumesGetTest-374048226 None] Lock "cinder-quobyte-7ca9a8c9-2c77-4d21-b1af-42435070a3fa" acquired by "delete_volume" :: waited 0.024s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:19:42 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad6cf0d-4392-4fb5-b475-4831a0171d39]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:19:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-68e1e0d2-dbb8-496a-8fb7-f56f8167ba53 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:42 devstack sudo[101357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa
Sep 28 18:19:42 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:42 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-68e1e0d2-dbb8-496a-8fb7-f56f8167ba53 tempest-VolumesGetTest-374048226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa" returned: 0 in 0.524s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-68e1e0d2-dbb8-496a-8fb7-f56f8167ba53 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:42 devstack sudo[101458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa
Sep 28 18:19:42 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:43 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-68e1e0d2-dbb8-496a-8fb7-f56f8167ba53 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-7ca9a8c9-2c77-4d21-b1af-42435070a3fa" returned: 0 in 0.707s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-68e1e0d2-dbb8-496a-8fb7-f56f8167ba53 tempest-VolumesGetTest-374048226 None] Lock "cinder-quobyte-7ca9a8c9-2c77-4d21-b1af-42435070a3fa" released by "delete_volume" :: held 1.307s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:19:43 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-68e1e0d2-dbb8-496a-8fb7-f56f8167ba53 tempest-VolumesGetTest-374048226 None] Created reservations ['6e5256fc-a1c8-4801-ac5b-69df9a324ac1', 'a82edda9-ca09-41f1-b509-89477921b5e1', '0cb19f2f-0e12-41af-8d67-44a3e78d55cf', 'ae7a5964-32b8-48ff-af01-4acd3e37ca74'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:19:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-68e1e0d2-dbb8-496a-8fb7-f56f8167ba53 tempest-VolumesGetTest-374048226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-68e1e0d2-dbb8-496a-8fb7-f56f8167ba53 tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-68e1e0d2-dbb8-496a-8fb7-f56f8167ba53 tempest-VolumesGetTest-374048226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:19:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-68e1e0d2-dbb8-496a-8fb7-f56f8167ba53 tempest-VolumesGetTest-374048226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:19:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-68e1e0d2-dbb8-496a-8fb7-f56f8167ba53 tempest-VolumesGetTest-374048226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-68e1e0d2-dbb8-496a-8fb7-f56f8167ba53 tempest-VolumesGetTest-374048226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:43 devstack sudo[101821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:19:43 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:44 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-68e1e0d2-dbb8-496a-8fb7-f56f8167ba53 tempest-VolumesGetTest-374048226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.412s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:44 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-68e1e0d2-dbb8-496a-8fb7-f56f8167ba53 tempest-VolumesGetTest-374048226 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:19:44 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-68e1e0d2-dbb8-496a-8fb7-f56f8167ba53 tempest-VolumesGetTest-374048226 None] Deleted volume successfully.
Sep 28 18:19:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-68e1e0d2-dbb8-496a-8fb7-f56f8167ba53 tempest-VolumesGetTest-374048226 None] Lock "cinder-7ca9a8c9-2c77-4d21-b1af-42435070a3fa-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Flow 'volume_create_manager' (df984890-df72-4f57-b926-c1f7cb589946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ddbe10-c7d5-4b66-b189-1968c573fe93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ddbe10-c7d5-4b66-b189-1968c573fe93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1682311677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbcc42a520c247068c14bedb9155c397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:51Z,use_quota=True,user_id='22b37533db6943e2b8082a0b8745a2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341ca506-cbc3-46a2-b0d3-68321b37ac7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341ca506-cbc3-46a2-b0d3-68321b37ac7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1fcd4f-6ea9-49bd-bc72-4a701507989a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1fcd4f-6ea9-49bd-bc72-4a701507989a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d', 'volume_name': 'volume-5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c4bc19-de31-419f-a2c2-aff2c5a7001d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c4bc19-de31-419f-a2c2-aff2c5a7001d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d22dd3-6ad9-45c9-9558-87cb029d05a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:51 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Volume 5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d', 'volume_size': 1}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1682311677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbcc42a520c247068c14bedb9155c397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:51Z,use_quota=True,user_id='22b37533db6943e2b8082a0b8745a2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Creating volume 5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:19:51 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:51 devstack sudo[101865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d 1073741824
Sep 28 18:19:51 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Flow 'volume_create_manager' (21a392c2-fa2c-426e-b6c7-abc95f7623c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea2ec2b-9637-476c-9967-5b9d2bc3e591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea2ec2b-9637-476c-9967-5b9d2bc3e591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1108712540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29508ce2-cf54-4b52-b301-8fd77cebbf9b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='65932cf1f73b4fd7b9e070e7e161d393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:51Z,use_quota=True,user_id='c8397e19485d4a9cb30f2291b792650e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fb2b4f-aa17-4efa-9466-72c9d47a8356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fb2b4f-aa17-4efa-9466-72c9d47a8356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb17743-bdda-4ad6-9620-88582e5130c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb17743-bdda-4ad6-9620-88582e5130c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29508ce2-cf54-4b52-b301-8fd77cebbf9b', 'volume_name': 'volume-29508ce2-cf54-4b52-b301-8fd77cebbf9b', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cedd32d0-34b8-4f77-8fd3-5bbfce34cd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cedd32d0-34b8-4f77-8fd3-5bbfce34cd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1f6e77-1e88-4697-8b09-2e2db92dd3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:51 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Volume 29508ce2-cf54-4b52-b301-8fd77cebbf9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29508ce2-cf54-4b52-b301-8fd77cebbf9b', 'volume_size': 1}
Sep 28 18:19:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:52 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d 1073741824" returned: 0 in 0.878s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:52 devstack sudo[101872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d
Sep 28 18:19:52 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:52 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d" returned: 0 in 0.598s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:19:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.407s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1108712540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29508ce2-cf54-4b52-b301-8fd77cebbf9b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='65932cf1f73b4fd7b9e070e7e161d393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:51Z,use_quota=True,user_id='c8397e19485d4a9cb30f2291b792650e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:19:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Creating volume 29508ce2-cf54-4b52-b301-8fd77cebbf9b {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:19:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:19:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:19:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:19:53 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:19:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-29508ce2-cf54-4b52-b301-8fd77cebbf9b 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d22dd3-6ad9-45c9-9558-87cb029d05a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:53 devstack sudo[101876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-29508ce2-cf54-4b52-b301-8fd77cebbf9b 1073741824
Sep 28 18:19:53 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34d8fbb-3a7a-40de-a00c-92e8db2f9f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:53 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Volume volume-5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d (5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d): created successfully
Sep 28 18:19:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34d8fbb-3a7a-40de-a00c-92e8db2f9f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:53 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Flow 'volume_create_manager' (df984890-df72-4f57-b926-c1f7cb589946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:53 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-5db0cf2c-4762-4a53-b23b-46cd3aed3f24 tempest-VolumesTransfersV357Test-1753180745 None] Created volume successfully.
Sep 28 18:19:53 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-29508ce2-cf54-4b52-b301-8fd77cebbf9b 1073741824" returned: 0 in 0.570s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-29508ce2-cf54-4b52-b301-8fd77cebbf9b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:53 devstack sudo[101881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-29508ce2-cf54-4b52-b301-8fd77cebbf9b
Sep 28 18:19:53 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:53 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-29508ce2-cf54-4b52-b301-8fd77cebbf9b" returned: 0 in 0.317s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:19:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1f6e77-1e88-4697-8b09-2e2db92dd3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29508ce2-cf54-4b52-b301-8fd77cebbf9b', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17100b21-6138-4d2f-a1d9-f805a36e6a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:54 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Volume volume-29508ce2-cf54-4b52-b301-8fd77cebbf9b (29508ce2-cf54-4b52-b301-8fd77cebbf9b): created successfully
Sep 28 18:19:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17100b21-6138-4d2f-a1d9-f805a36e6a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Flow 'volume_create_manager' (21a392c2-fa2c-426e-b6c7-abc95f7623c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:54 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-066c66cd-a4ad-4a61-b7b3-f8541cbfa3f1 tempest-VolumesListTestJSON-976247812 None] Created volume successfully.
Sep 28 18:19:55 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:19:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Flow 'volume_create_manager' (e90b2c0f-d92f-463c-a6f4-818bd272dadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62308dfe-367d-4859-ac5d-73a6e0b22fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62308dfe-367d-4859-ac5d-73a6e0b22fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2029461398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d20b824a-c4d1-4a01-997f-af42deb410da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='65932cf1f73b4fd7b9e070e7e161d393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:55Z,use_quota=True,user_id='c8397e19485d4a9cb30f2291b792650e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92be4a8f-c2ca-4cde-8de3-bee6643016e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92be4a8f-c2ca-4cde-8de3-bee6643016e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d865189c-e30d-41b3-ae37-111b918909f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d865189c-e30d-41b3-ae37-111b918909f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd20b824a-c4d1-4a01-997f-af42deb410da', 'volume_name': 'volume-d20b824a-c4d1-4a01-997f-af42deb410da', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df70693e-ef35-4a44-9f7a-a0d17fbc7045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df70693e-ef35-4a44-9f7a-a0d17fbc7045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df16a28-ccea-4024-9321-cb5d8227c63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:55 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Volume d20b824a-c4d1-4a01-997f-af42deb410da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d20b824a-c4d1-4a01-997f-af42deb410da', 'volume_size': 1}
Sep 28 18:19:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2029461398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d20b824a-c4d1-4a01-997f-af42deb410da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='65932cf1f73b4fd7b9e070e7e161d393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:55Z,use_quota=True,user_id='c8397e19485d4a9cb30f2291b792650e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:19:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Creating volume d20b824a-c4d1-4a01-997f-af42deb410da {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:19:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:19:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:19:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:19:55 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:19:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d20b824a-c4d1-4a01-997f-af42deb410da 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:55 devstack sudo[101884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d20b824a-c4d1-4a01-997f-af42deb410da 1073741824
Sep 28 18:19:55 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:55 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-6446b167-f432-4fbe-98ab-a2c620bad4be tempest-VolumesTransfersV357Test-509840957 None] Transfer volume completed successfully.
Sep 28 18:19:56 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d20b824a-c4d1-4a01-997f-af42deb410da 1073741824" returned: 0 in 0.784s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d20b824a-c4d1-4a01-997f-af42deb410da {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:56 devstack sudo[101890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d20b824a-c4d1-4a01-997f-af42deb410da
Sep 28 18:19:56 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:56 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d20b824a-c4d1-4a01-997f-af42deb410da" returned: 0 in 0.336s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:19:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-fd50509f-d818-4343-87d4-3e03d8948af1 tempest-VolumesTransfersV357Test-538570251 None] Acquiring lock "cinder-5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:19:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df16a28-ccea-4024-9321-cb5d8227c63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d20b824a-c4d1-4a01-997f-af42deb410da', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b5939f9-f79a-4a48-8f45-fa0e8114d32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:56 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Volume volume-d20b824a-c4d1-4a01-997f-af42deb410da (d20b824a-c4d1-4a01-997f-af42deb410da): created successfully
Sep 28 18:19:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b5939f9-f79a-4a48-8f45-fa0e8114d32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Flow 'volume_create_manager' (e90b2c0f-d92f-463c-a6f4-818bd272dadb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-fd50509f-d818-4343-87d4-3e03d8948af1 tempest-VolumesTransfersV357Test-538570251 None] Lock "cinder-5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d-delete_volume" acquired by "delete_volume" :: waited 0.161s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:19:56 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d11a85b6-34ab-44b3-aff5-1f6715018019 tempest-VolumesListTestJSON-976247812 None] Created volume successfully.
Sep 28 18:19:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-fd50509f-d818-4343-87d4-3e03d8948af1 tempest-VolumesTransfersV357Test-538570251 None] Acquiring lock "cinder-quobyte-5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:19:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-fd50509f-d818-4343-87d4-3e03d8948af1 tempest-VolumesTransfersV357Test-538570251 None] Lock "cinder-quobyte-5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d" acquired by "delete_volume" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:19:56 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c5de64-85cb-4452-ad14-4dff57894a74]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:19:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fd50509f-d818-4343-87d4-3e03d8948af1 tempest-VolumesTransfersV357Test-538570251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:57 devstack sudo[101893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d
Sep 28 18:19:57 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:57 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fd50509f-d818-4343-87d4-3e03d8948af1 tempest-VolumesTransfersV357Test-538570251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d" returned: 0 in 0.728s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fd50509f-d818-4343-87d4-3e03d8948af1 tempest-VolumesTransfersV357Test-538570251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:57 devstack sudo[101900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d
Sep 28 18:19:57 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:58 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fd50509f-d818-4343-87d4-3e03d8948af1 tempest-VolumesTransfersV357Test-538570251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d" returned: 0 in 0.481s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-fd50509f-d818-4343-87d4-3e03d8948af1 tempest-VolumesTransfersV357Test-538570251 None] Lock "cinder-quobyte-5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d" released by "delete_volume" :: held 1.267s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-fd50509f-d818-4343-87d4-3e03d8948af1 tempest-VolumesTransfersV357Test-538570251 None] Created reservations ['5712453e-1980-4976-8cd4-9a62ac4c7c66', 'c57de35c-7834-4014-8c8a-2e9fc44d599f', '387ab11f-2aa3-49fc-9c87-6b140275155c', 'e3e781e2-2d75-42b5-8118-39f03c7c8087'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-fd50509f-d818-4343-87d4-3e03d8948af1 tempest-VolumesTransfersV357Test-538570251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-fd50509f-d818-4343-87d4-3e03d8948af1 tempest-VolumesTransfersV357Test-538570251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-fd50509f-d818-4343-87d4-3e03d8948af1 tempest-VolumesTransfersV357Test-538570251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-fd50509f-d818-4343-87d4-3e03d8948af1 tempest-VolumesTransfersV357Test-538570251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-fd50509f-d818-4343-87d4-3e03d8948af1 tempest-VolumesTransfersV357Test-538570251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fd50509f-d818-4343-87d4-3e03d8948af1 tempest-VolumesTransfersV357Test-538570251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:58 devstack sudo[101903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:19:58 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Flow 'volume_create_manager' (b3871ee3-6ba9-4bda-bb06-cfc45777eaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5851143-be5d-4f67-a0cc-11116c589c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5851143-be5d-4f67-a0cc-11116c589c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-369594663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf5b774-7b6d-4372-94db-bd90ebbdfb6c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='65932cf1f73b4fd7b9e070e7e161d393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:58Z,use_quota=True,user_id='c8397e19485d4a9cb30f2291b792650e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fb5a06-f03c-4f83-bc3c-fa9a8cd41bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fb5a06-f03c-4f83-bc3c-fa9a8cd41bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1877d91-bc72-4850-981a-d3f3458b0223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1877d91-bc72-4850-981a-d3f3458b0223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cf5b774-7b6d-4372-94db-bd90ebbdfb6c', 'volume_name': 'volume-2cf5b774-7b6d-4372-94db-bd90ebbdfb6c', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbcf7916-decb-4750-aa8d-1f5b8e21ebf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbcf7916-decb-4750-aa8d-1f5b8e21ebf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9270e40e-132b-4757-9856-70192c8c668c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:58 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Volume 2cf5b774-7b6d-4372-94db-bd90ebbdfb6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cf5b774-7b6d-4372-94db-bd90ebbdfb6c', 'volume_size': 1}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-369594663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf5b774-7b6d-4372-94db-bd90ebbdfb6c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='65932cf1f73b4fd7b9e070e7e161d393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:58Z,use_quota=True,user_id='c8397e19485d4a9cb30f2291b792650e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Creating volume 2cf5b774-7b6d-4372-94db-bd90ebbdfb6c {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:19:58 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cf5b774-7b6d-4372-94db-bd90ebbdfb6c 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:58 devstack sudo[101906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cf5b774-7b6d-4372-94db-bd90ebbdfb6c 1073741824
Sep 28 18:19:58 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:58 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fd50509f-d818-4343-87d4-3e03d8948af1 tempest-VolumesTransfersV357Test-538570251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.324s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-fd50509f-d818-4343-87d4-3e03d8948af1 tempest-VolumesTransfersV357Test-538570251 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:19:58 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-fd50509f-d818-4343-87d4-3e03d8948af1 tempest-VolumesTransfersV357Test-538570251 None] Deleted volume successfully.
Sep 28 18:19:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-fd50509f-d818-4343-87d4-3e03d8948af1 tempest-VolumesTransfersV357Test-538570251 None] Lock "cinder-5e3d170c-1ea7-42cc-b9e2-7ab1366c8f7d-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:19:59 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cf5b774-7b6d-4372-94db-bd90ebbdfb6c 1073741824" returned: 0 in 0.601s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cf5b774-7b6d-4372-94db-bd90ebbdfb6c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:19:59 devstack sudo[101911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cf5b774-7b6d-4372-94db-bd90ebbdfb6c
Sep 28 18:19:59 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:19:59 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root
Sep 28 18:19:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cf5b774-7b6d-4372-94db-bd90ebbdfb6c" returned: 0 in 0.394s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:19:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:19:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:19:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9270e40e-132b-4757-9856-70192c8c668c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cf5b774-7b6d-4372-94db-bd90ebbdfb6c', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d326af9d-929f-4fe7-a5d3-e1ce73c11ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:19:59 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Volume volume-2cf5b774-7b6d-4372-94db-bd90ebbdfb6c (2cf5b774-7b6d-4372-94db-bd90ebbdfb6c): created successfully
Sep 28 18:19:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d326af9d-929f-4fe7-a5d3-e1ce73c11ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:19:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Flow 'volume_create_manager' (b3871ee3-6ba9-4bda-bb06-cfc45777eaed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:19:59 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-b26db971-f757-4210-a520-f9f4dc89b245 tempest-VolumesListTestJSON-976247812 None] Created volume successfully.
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Flow 'volume_create_manager' (aee050bf-0457-4bc8-9837-c06c0c614478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12e8d1b-5bb9-4f75-a0ea-abbfc8d0d090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12e8d1b-5bb9-4f75-a0ea-abbfc8d0d090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-481282794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3567a8a6-83ee-46a5-8093-e564c922576d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbcc42a520c247068c14bedb9155c397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:00Z,use_quota=True,user_id='22b37533db6943e2b8082a0b8745a2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab43aa9-a792-45cb-82fb-5dfc6188b242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab43aa9-a792-45cb-82fb-5dfc6188b242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad771b8-e393-43d9-ab50-aa22198cca0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad771b8-e393-43d9-ab50-aa22198cca0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3567a8a6-83ee-46a5-8093-e564c922576d', 'volume_name': 'volume-3567a8a6-83ee-46a5-8093-e564c922576d', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4347245-f7e5-49dd-9887-04db6e013a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4347245-f7e5-49dd-9887-04db6e013a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a2d2d0-37b5-4c9b-bda9-f8918b1e6ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:00 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Volume 3567a8a6-83ee-46a5-8093-e564c922576d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3567a8a6-83ee-46a5-8093-e564c922576d', 'volume_size': 1}
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-481282794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3567a8a6-83ee-46a5-8093-e564c922576d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbcc42a520c247068c14bedb9155c397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:00Z,use_quota=True,user_id='22b37533db6943e2b8082a0b8745a2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Creating volume 3567a8a6-83ee-46a5-8093-e564c922576d {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:20:00 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3567a8a6-83ee-46a5-8093-e564c922576d 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:00 devstack sudo[101914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3567a8a6-83ee-46a5-8093-e564c922576d 1073741824
Sep 28 18:20:00 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:00 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3567a8a6-83ee-46a5-8093-e564c922576d 1073741824" returned: 0 in 0.591s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3567a8a6-83ee-46a5-8093-e564c922576d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:00 devstack sudo[101923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3567a8a6-83ee-46a5-8093-e564c922576d
Sep 28 18:20:00 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:01 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3567a8a6-83ee-46a5-8093-e564c922576d" returned: 0 in 0.396s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:20:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a2d2d0-37b5-4c9b-bda9-f8918b1e6ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3567a8a6-83ee-46a5-8093-e564c922576d', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e11fb35-3f65-440a-8510-332f6c83749f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:01 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Volume volume-3567a8a6-83ee-46a5-8093-e564c922576d (3567a8a6-83ee-46a5-8093-e564c922576d): created successfully
Sep 28 18:20:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e11fb35-3f65-440a-8510-332f6c83749f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Flow 'volume_create_manager' (aee050bf-0457-4bc8-9837-c06c0c614478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:20:01 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-ba6d31ad-d01e-485e-a1dd-fb6631b24e5c tempest-VolumesTransfersV357Test-1753180745 None] Created volume successfully.
Sep 28 18:20:02 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0ce57f55-b249-4629-8985-6d4d028f825b tempest-VolumesTransfersV357Test-538570251 None] Acquiring lock "cinder-3567a8a6-83ee-46a5-8093-e564c922576d-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:02 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0ce57f55-b249-4629-8985-6d4d028f825b tempest-VolumesTransfersV357Test-538570251 None] Lock "cinder-3567a8a6-83ee-46a5-8093-e564c922576d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:02 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0ce57f55-b249-4629-8985-6d4d028f825b tempest-VolumesTransfersV357Test-538570251 None] Acquiring lock "cinder-quobyte-3567a8a6-83ee-46a5-8093-e564c922576d" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:02 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0ce57f55-b249-4629-8985-6d4d028f825b tempest-VolumesTransfersV357Test-538570251 None] Lock "cinder-quobyte-3567a8a6-83ee-46a5-8093-e564c922576d" acquired by "delete_volume" :: waited 0.028s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:02 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a8bf98-ef5a-4e66-815b-4df0df1e135f]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0ce57f55-b249-4629-8985-6d4d028f825b tempest-VolumesTransfersV357Test-538570251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3567a8a6-83ee-46a5-8093-e564c922576d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:02 devstack sudo[101956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3567a8a6-83ee-46a5-8093-e564c922576d
Sep 28 18:20:02 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:03 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0ce57f55-b249-4629-8985-6d4d028f825b tempest-VolumesTransfersV357Test-538570251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3567a8a6-83ee-46a5-8093-e564c922576d" returned: 0 in 0.421s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0ce57f55-b249-4629-8985-6d4d028f825b tempest-VolumesTransfersV357Test-538570251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3567a8a6-83ee-46a5-8093-e564c922576d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:03 devstack sudo[101963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3567a8a6-83ee-46a5-8093-e564c922576d
Sep 28 18:20:03 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:03 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-65655840-741d-41b8-83f8-3260e1138d57 tempest-VolumesListTestJSON-976247812 None] Acquiring lock "cinder-2cf5b774-7b6d-4372-94db-bd90ebbdfb6c-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0ce57f55-b249-4629-8985-6d4d028f825b tempest-VolumesTransfersV357Test-538570251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3567a8a6-83ee-46a5-8093-e564c922576d" returned: 0 in 0.328s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0ce57f55-b249-4629-8985-6d4d028f825b tempest-VolumesTransfersV357Test-538570251 None] Lock "cinder-quobyte-3567a8a6-83ee-46a5-8093-e564c922576d" released by "delete_volume" :: held 0.822s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-65655840-741d-41b8-83f8-3260e1138d57 tempest-VolumesListTestJSON-976247812 None] Lock "cinder-2cf5b774-7b6d-4372-94db-bd90ebbdfb6c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-65655840-741d-41b8-83f8-3260e1138d57 tempest-VolumesListTestJSON-976247812 None] Acquiring lock "cinder-quobyte-2cf5b774-7b6d-4372-94db-bd90ebbdfb6c" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-65655840-741d-41b8-83f8-3260e1138d57 tempest-VolumesListTestJSON-976247812 None] Lock "cinder-quobyte-2cf5b774-7b6d-4372-94db-bd90ebbdfb6c" acquired by "delete_volume" :: waited 0.027s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:03 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e013ab-d2a5-4689-ab5e-2b704b951225]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-65655840-741d-41b8-83f8-3260e1138d57 tempest-VolumesListTestJSON-976247812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cf5b774-7b6d-4372-94db-bd90ebbdfb6c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:03 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-0ce57f55-b249-4629-8985-6d4d028f825b tempest-VolumesTransfersV357Test-538570251 None] Created reservations ['293ba208-692b-42b9-a465-9e66c2c207f9', '92fd10b0-9737-48b7-b00e-405954548967', 'b8d80d92-da67-4c40-a83a-85b49add2fbd', 'fa9d698f-0ce7-484e-825f-5487f3571917'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:20:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0ce57f55-b249-4629-8985-6d4d028f825b tempest-VolumesTransfersV357Test-538570251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0ce57f55-b249-4629-8985-6d4d028f825b tempest-VolumesTransfersV357Test-538570251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:03 devstack sudo[101966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cf5b774-7b6d-4372-94db-bd90ebbdfb6c
Sep 28 18:20:03 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:03 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0ce57f55-b249-4629-8985-6d4d028f825b tempest-VolumesTransfersV357Test-538570251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:20:03 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0ce57f55-b249-4629-8985-6d4d028f825b tempest-VolumesTransfersV357Test-538570251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:20:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0ce57f55-b249-4629-8985-6d4d028f825b tempest-VolumesTransfersV357Test-538570251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0ce57f55-b249-4629-8985-6d4d028f825b tempest-VolumesTransfersV357Test-538570251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:03 devstack sudo[101968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:20:03 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:04 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-65655840-741d-41b8-83f8-3260e1138d57 tempest-VolumesListTestJSON-976247812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cf5b774-7b6d-4372-94db-bd90ebbdfb6c" returned: 0 in 0.456s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-65655840-741d-41b8-83f8-3260e1138d57 tempest-VolumesListTestJSON-976247812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cf5b774-7b6d-4372-94db-bd90ebbdfb6c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:04 devstack sudo[101977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cf5b774-7b6d-4372-94db-bd90ebbdfb6c
Sep 28 18:20:04 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:04 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0ce57f55-b249-4629-8985-6d4d028f825b tempest-VolumesTransfersV357Test-538570251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.335s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:04 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-0ce57f55-b249-4629-8985-6d4d028f825b tempest-VolumesTransfersV357Test-538570251 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:20:04 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-0ce57f55-b249-4629-8985-6d4d028f825b tempest-VolumesTransfersV357Test-538570251 None] Deleted volume successfully.
Sep 28 18:20:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0ce57f55-b249-4629-8985-6d4d028f825b tempest-VolumesTransfersV357Test-538570251 None] Lock "cinder-3567a8a6-83ee-46a5-8093-e564c922576d-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:04 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-65655840-741d-41b8-83f8-3260e1138d57 tempest-VolumesListTestJSON-976247812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2cf5b774-7b6d-4372-94db-bd90ebbdfb6c" returned: 0 in 0.331s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-65655840-741d-41b8-83f8-3260e1138d57 tempest-VolumesListTestJSON-976247812 None] Lock "cinder-quobyte-2cf5b774-7b6d-4372-94db-bd90ebbdfb6c" released by "delete_volume" :: held 0.840s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:04 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-65655840-741d-41b8-83f8-3260e1138d57 tempest-VolumesListTestJSON-976247812 None] Created reservations ['4e1db117-cb00-41e3-bfbc-a4d01b58ed3c', 'd3106a2b-a662-4ed5-a042-10c25752053f', '220d4ebc-c719-4b5a-933f-10a8595919e4', 'bafbec9a-fdb7-4f24-bea5-06e8b9f9f449'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:20:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-65655840-741d-41b8-83f8-3260e1138d57 tempest-VolumesListTestJSON-976247812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-65655840-741d-41b8-83f8-3260e1138d57 tempest-VolumesListTestJSON-976247812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:04 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-65655840-741d-41b8-83f8-3260e1138d57 tempest-VolumesListTestJSON-976247812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:20:04 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-65655840-741d-41b8-83f8-3260e1138d57 tempest-VolumesListTestJSON-976247812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:20:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-65655840-741d-41b8-83f8-3260e1138d57 tempest-VolumesListTestJSON-976247812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-65655840-741d-41b8-83f8-3260e1138d57 tempest-VolumesListTestJSON-976247812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:04 devstack sudo[101984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:20:04 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3b728748-e6d0-4a28-94a5-fd83143bdc09 tempest-VolumesListTestJSON-976247812 None] Acquiring lock "cinder-d20b824a-c4d1-4a01-997f-af42deb410da-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3b728748-e6d0-4a28-94a5-fd83143bdc09 tempest-VolumesListTestJSON-976247812 None] Lock "cinder-d20b824a-c4d1-4a01-997f-af42deb410da-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3b728748-e6d0-4a28-94a5-fd83143bdc09 tempest-VolumesListTestJSON-976247812 None] Acquiring lock "cinder-quobyte-d20b824a-c4d1-4a01-997f-af42deb410da" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3b728748-e6d0-4a28-94a5-fd83143bdc09 tempest-VolumesListTestJSON-976247812 None] Lock "cinder-quobyte-d20b824a-c4d1-4a01-997f-af42deb410da" acquired by "delete_volume" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:04 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecd77f4-78ac-4a10-904a-239178027e58]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3b728748-e6d0-4a28-94a5-fd83143bdc09 tempest-VolumesListTestJSON-976247812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d20b824a-c4d1-4a01-997f-af42deb410da {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:05 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-65655840-741d-41b8-83f8-3260e1138d57 tempest-VolumesListTestJSON-976247812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.438s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:05 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-65655840-741d-41b8-83f8-3260e1138d57 tempest-VolumesListTestJSON-976247812 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:20:05 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-65655840-741d-41b8-83f8-3260e1138d57 tempest-VolumesListTestJSON-976247812 None] Deleted volume successfully.
Sep 28 18:20:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-65655840-741d-41b8-83f8-3260e1138d57 tempest-VolumesListTestJSON-976247812 None] Lock "cinder-2cf5b774-7b6d-4372-94db-bd90ebbdfb6c-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:05 devstack sudo[101987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d20b824a-c4d1-4a01-997f-af42deb410da
Sep 28 18:20:05 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:05 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3b728748-e6d0-4a28-94a5-fd83143bdc09 tempest-VolumesListTestJSON-976247812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d20b824a-c4d1-4a01-997f-af42deb410da" returned: 0 in 0.559s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3b728748-e6d0-4a28-94a5-fd83143bdc09 tempest-VolumesListTestJSON-976247812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d20b824a-c4d1-4a01-997f-af42deb410da {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:05 devstack sudo[101992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d20b824a-c4d1-4a01-997f-af42deb410da
Sep 28 18:20:05 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:05 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3b728748-e6d0-4a28-94a5-fd83143bdc09 tempest-VolumesListTestJSON-976247812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d20b824a-c4d1-4a01-997f-af42deb410da" returned: 0 in 0.370s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3b728748-e6d0-4a28-94a5-fd83143bdc09 tempest-VolumesListTestJSON-976247812 None] Lock "cinder-quobyte-d20b824a-c4d1-4a01-997f-af42deb410da" released by "delete_volume" :: held 1.005s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:06 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-3b728748-e6d0-4a28-94a5-fd83143bdc09 tempest-VolumesListTestJSON-976247812 None] Created reservations ['2f4ea867-93af-4c8d-beb4-f274a746ddcb', 'a7f7d20e-3f7b-4584-91b3-fc99ded99fa5', 'd953ee3c-0511-4a46-85c6-a2247fc7cc77', 'affc2a25-a6ac-4757-aba5-bf057ca34f2b'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:20:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3b728748-e6d0-4a28-94a5-fd83143bdc09 tempest-VolumesListTestJSON-976247812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3b728748-e6d0-4a28-94a5-fd83143bdc09 tempest-VolumesListTestJSON-976247812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:06 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3b728748-e6d0-4a28-94a5-fd83143bdc09 tempest-VolumesListTestJSON-976247812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:20:06 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3b728748-e6d0-4a28-94a5-fd83143bdc09 tempest-VolumesListTestJSON-976247812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:20:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3b728748-e6d0-4a28-94a5-fd83143bdc09 tempest-VolumesListTestJSON-976247812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3b728748-e6d0-4a28-94a5-fd83143bdc09 tempest-VolumesListTestJSON-976247812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:06 devstack sudo[102001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:20:06 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:06 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3b728748-e6d0-4a28-94a5-fd83143bdc09 tempest-VolumesListTestJSON-976247812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.308s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:06 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-3b728748-e6d0-4a28-94a5-fd83143bdc09 tempest-VolumesListTestJSON-976247812 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:20:06 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-3b728748-e6d0-4a28-94a5-fd83143bdc09 tempest-VolumesListTestJSON-976247812 None] Deleted volume successfully.
Sep 28 18:20:06 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3b728748-e6d0-4a28-94a5-fd83143bdc09 tempest-VolumesListTestJSON-976247812 None] Lock "cinder-d20b824a-c4d1-4a01-997f-af42deb410da-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3891a194-9f5c-49b9-ba86-128cb993bfed tempest-VolumesListTestJSON-976247812 None] Acquiring lock "cinder-29508ce2-cf54-4b52-b301-8fd77cebbf9b-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3891a194-9f5c-49b9-ba86-128cb993bfed tempest-VolumesListTestJSON-976247812 None] Lock "cinder-29508ce2-cf54-4b52-b301-8fd77cebbf9b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3891a194-9f5c-49b9-ba86-128cb993bfed tempest-VolumesListTestJSON-976247812 None] Acquiring lock "cinder-quobyte-29508ce2-cf54-4b52-b301-8fd77cebbf9b" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3891a194-9f5c-49b9-ba86-128cb993bfed tempest-VolumesListTestJSON-976247812 None] Lock "cinder-quobyte-29508ce2-cf54-4b52-b301-8fd77cebbf9b" acquired by "delete_volume" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:07 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc28c00-79b1-4b66-94e7-8349c0cd7466]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3891a194-9f5c-49b9-ba86-128cb993bfed tempest-VolumesListTestJSON-976247812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-29508ce2-cf54-4b52-b301-8fd77cebbf9b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:07 devstack sudo[102004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-29508ce2-cf54-4b52-b301-8fd77cebbf9b
Sep 28 18:20:07 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:07 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3891a194-9f5c-49b9-ba86-128cb993bfed tempest-VolumesListTestJSON-976247812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-29508ce2-cf54-4b52-b301-8fd77cebbf9b" returned: 0 in 0.587s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3891a194-9f5c-49b9-ba86-128cb993bfed tempest-VolumesListTestJSON-976247812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-29508ce2-cf54-4b52-b301-8fd77cebbf9b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:08 devstack sudo[102009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-29508ce2-cf54-4b52-b301-8fd77cebbf9b
Sep 28 18:20:08 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:08 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3891a194-9f5c-49b9-ba86-128cb993bfed tempest-VolumesListTestJSON-976247812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-29508ce2-cf54-4b52-b301-8fd77cebbf9b" returned: 0 in 0.362s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3891a194-9f5c-49b9-ba86-128cb993bfed tempest-VolumesListTestJSON-976247812 None] Lock "cinder-quobyte-29508ce2-cf54-4b52-b301-8fd77cebbf9b" released by "delete_volume" :: held 1.006s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:08 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-3891a194-9f5c-49b9-ba86-128cb993bfed tempest-VolumesListTestJSON-976247812 None] Created reservations ['2e782dd8-e6d4-4e34-af77-b93777b40941', '0c7ed82f-e6a0-476c-934f-293973e21486', 'c552ffaf-059d-44b2-8f64-2ac90d0b6249', '927465e0-de26-4864-bf84-c5ed28ca6da2'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:20:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3891a194-9f5c-49b9-ba86-128cb993bfed tempest-VolumesListTestJSON-976247812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3891a194-9f5c-49b9-ba86-128cb993bfed tempest-VolumesListTestJSON-976247812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3891a194-9f5c-49b9-ba86-128cb993bfed tempest-VolumesListTestJSON-976247812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:20:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3891a194-9f5c-49b9-ba86-128cb993bfed tempest-VolumesListTestJSON-976247812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:20:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3891a194-9f5c-49b9-ba86-128cb993bfed tempest-VolumesListTestJSON-976247812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3891a194-9f5c-49b9-ba86-128cb993bfed tempest-VolumesListTestJSON-976247812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:08 devstack sudo[102012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:20:08 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:08 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3891a194-9f5c-49b9-ba86-128cb993bfed tempest-VolumesListTestJSON-976247812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.354s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:08 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-3891a194-9f5c-49b9-ba86-128cb993bfed tempest-VolumesListTestJSON-976247812 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:20:08 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-3891a194-9f5c-49b9-ba86-128cb993bfed tempest-VolumesListTestJSON-976247812 None] Deleted volume successfully.
Sep 28 18:20:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3891a194-9f5c-49b9-ba86-128cb993bfed tempest-VolumesListTestJSON-976247812 None] Lock "cinder-29508ce2-cf54-4b52-b301-8fd77cebbf9b-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:14 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:UPDATE=141,cinder:SELECT=104,cinder:DELETE=13,cinder:INSERT=44 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:20:14 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=115,cinder:UPDATE=138,cinder:INSERT=40,cinder:DELETE=12 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:20:14 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:20:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Flow 'volume_create_manager' (db287e49-8497-4032-9468-0e5a17fb3e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:20:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13cc9356-15f9-400e-87dc-3667fe56399e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13cc9356-15f9-400e-87dc-3667fe56399e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1035698830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2d0ead-1322-4681-9ccd-237a71a2d107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='536d3a7fa9304d879aea712fe124036e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:14Z,use_quota=True,user_id='38b7294e7d544a55936c8098828f1afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35312a19-3031-40d9-be1c-50b01a4274f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35312a19-3031-40d9-be1c-50b01a4274f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744239a1-47fc-4444-92bf-f0dd9ce290d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:14 devstack cinder-volume[87046]: DEBUG cinder.image.glance [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Creating Keystone auth plugin from conf {{(pid=87046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Flow 'volume_create_manager' (8759bd79-432a-4105-a5d3-45ae0fb68354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121c650a-e92b-48a8-be41-16687373610a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744239a1-47fc-4444-92bf-f0dd9ce290d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cc2d0ead-1322-4681-9ccd-237a71a2d107', 'volume_name': 'volume-cc2d0ead-1322-4681-9ccd-237a71a2d107', 'volume_size': 1, 'image_id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de2452cfca174dfbbc7b50b163b23faa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'created_at': datetime.datetime(2026, 9, 28, 15, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 58, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aa4a64fe0>}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9037754-4616-4d0d-9e59-e82dd70b0ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9037754-4616-4d0d-9e59-e82dd70b0ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a70f564-3a10-431a-b255-8471275f85a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:15 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Volume cc2d0ead-1322-4681-9ccd-237a71a2d107: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cc2d0ead-1322-4681-9ccd-237a71a2d107', 'volume_size': 1, 'image_id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de2452cfca174dfbbc7b50b163b23faa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'created_at': datetime.datetime(2026, 9, 28, 15, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 58, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aa4a64fe0>}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Trying to clone cc2d0ead-1322-4681-9ccd-237a71a2d107 from image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}]). {{(pid=87046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121c650a-e92b-48a8-be41-16687373610a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-213468148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b64ec2-151d-405f-80cd-9e6d9dae0fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='209597b4a3c44b9c94343e53cce5d2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:15Z,use_quota=True,user_id='b7f0ceffb5394672a3ff9d0adb07693b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1b5577-667f-4483-a0df-98f2b2de8431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1b5577-667f-4483-a0df-98f2b2de8431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbecaaae-cbf7-49b5-a58c-631bd72f367d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbecaaae-cbf7-49b5-a58c-631bd72f367d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47b64ec2-151d-405f-80cd-9e6d9dae0fa9', 'volume_name': 'volume-47b64ec2-151d-405f-80cd-9e6d9dae0fa9', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (196e8bb9-1951-482e-9b24-5f52b146e1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (196e8bb9-1951-482e-9b24-5f52b146e1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2609efd0-b317-4c85-85a6-1f50cb2da98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:15 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Volume 47b64ec2-151d-405f-80cd-9e6d9dae0fa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47b64ec2-151d-405f-80cd-9e6d9dae0fa9', 'volume_size': 1}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-213468148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b64ec2-151d-405f-80cd-9e6d9dae0fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='209597b4a3c44b9c94343e53cce5d2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:15Z,use_quota=True,user_id='b7f0ceffb5394672a3ff9d0adb07693b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Creating volume 47b64ec2-151d-405f-80cd-9e6d9dae0fa9 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:20:15 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47b64ec2-151d-405f-80cd-9e6d9dae0fa9 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:15 devstack sudo[102029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47b64ec2-151d-405f-80cd-9e6d9dae0fa9 1073741824
Sep 28 18:20:15 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_a67c_jx1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 28 18:20:15 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Image download 20.69 MB at 20.69 MB/s
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ea335c-1da2-4de3-8858-efbb46914018]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_a67c_jx1devstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:15 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47b64ec2-151d-405f-80cd-9e6d9dae0fa9 1073741824" returned: 0 in 0.645s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:15 devstack sudo[102036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_a67c_jx1devstack@QuobyteHD
Sep 28 18:20:15 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47b64ec2-151d-405f-80cd-9e6d9dae0fa9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:15 devstack sudo[102038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47b64ec2-151d-405f-80cd-9e6d9dae0fa9
Sep 28 18:20:15 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:16 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_a67c_jx1devstack@QuobyteHD" returned: 0 in 0.514s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Temporary image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 is fetched for user 38b7294e7d544a55936c8098828f1afe. {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 28 18:20:16 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47b64ec2-151d-405f-80cd-9e6d9dae0fa9" returned: 0 in 0.302s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2609efd0-b317-4c85-85a6-1f50cb2da98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47b64ec2-151d-405f-80cd-9e6d9dae0fa9', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e45aeeb-18f6-4870-8596-d36ff95cf159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:16 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Volume volume-47b64ec2-151d-405f-80cd-9e6d9dae0fa9 (47b64ec2-151d-405f-80cd-9e6d9dae0fa9): created successfully
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e45aeeb-18f6-4870-8596-d36ff95cf159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Flow 'volume_create_manager' (8759bd79-432a-4105-a5d3-45ae0fb68354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:20:16 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-2ad35374-bc8e-4bbc-bb92-4b192a164dc3 tempest-VolumesNegativeTest-15521259 None] Created volume successfully.
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f852a9a5-225f-4e8b-a35d-bbcc9f1edd4b]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_a67c_jx1devstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:16 devstack sudo[102044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_a67c_jx1devstack@QuobyteHD
Sep 28 18:20:16 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:16 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_a67c_jx1devstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1035698830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2d0ead-1322-4681-9ccd-237a71a2d107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='536d3a7fa9304d879aea712fe124036e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:14Z,use_quota=True,user_id='38b7294e7d544a55936c8098828f1afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Creating volume cc2d0ead-1322-4681-9ccd-237a71a2d107 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:20:16 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:20:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:16 devstack sudo[102049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107 1073741824
Sep 28 18:20:16 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:17 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107 1073741824" returned: 0 in 0.522s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:17 devstack sudo[102057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107
Sep 28 18:20:17 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:17 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107" returned: 0 in 0.305s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:20:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:17 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Attempting download of c5b6ff95-792c-4fb0-b8e7-dea90bc76834 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}])) to volume cc2d0ead-1322-4681-9ccd-237a71a2d107. {{(pid=87046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 28 18:20:17 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cc2314-755e-4e0e-85e9-c851b4bf6ee0]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_6akwl5e7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:17 devstack sudo[102065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_6akwl5e7
Sep 28 18:20:17 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:18 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_6akwl5e7" returned: 0 in 0.552s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_6akwl5e7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:18 devstack sudo[102078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_6akwl5e7
Sep 28 18:20:18 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-17b6c9e0-74cb-4f6d-9afd-fe602be99a6a req-6669593c-faf3-4bab-b5f7-28cf255d3d10 tempest-TestInstancesWithCinderVolumes-992173720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-17b6c9e0-74cb-4f6d-9afd-fe602be99a6a req-6669593c-faf3-4bab-b5f7-28cf255d3d10 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-17b6c9e0-74cb-4f6d-9afd-fe602be99a6a req-6669593c-faf3-4bab-b5f7-28cf255d3d10 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-17b6c9e0-74cb-4f6d-9afd-fe602be99a6a req-6669593c-faf3-4bab-b5f7-28cf255d3d10 tempest-TestInstancesWithCinderVolumes-992173720 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04ea5d54-dfd6-4faa-be01-d4d4481d37a0', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:20:18 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-17b6c9e0-74cb-4f6d-9afd-fe602be99a6a req-6669593c-faf3-4bab-b5f7-28cf255d3d10 tempest-TestInstancesWithCinderVolumes-992173720 None] attachment_update completed successfully.
Sep 28 18:20:18 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_6akwl5e7" returned: 1 in 0.464s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_6akwl5e7' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:20:18 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29b7c95-0047-4cc3-ac60-107bb22f863a]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_a67c_jx1devstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:18 devstack sudo[102085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_a67c_jx1devstack@QuobyteHD
Sep 28 18:20:18 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:19 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_a67c_jx1devstack@QuobyteHD" returned: 0 in 0.415s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:19 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] c5b6ff95-792c-4fb0-b8e7-dea90bc76834 was qcow2, converting to qcow2 {{(pid=87046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 28 18:20:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_a67c_jx1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:19 devstack sudo[102095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_a67c_jx1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107
Sep 28 18:20:19 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-4de0dd57-616f-448f-bccd-ab6a74e1befd req-c2d24924-5a70-4253-96a2-b38a8e60c199 tempest-TestInstancesWithCinderVolumes-992173720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-4de0dd57-616f-448f-bccd-ab6a74e1befd req-c2d24924-5a70-4253-96a2-b38a8e60c199 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-4de0dd57-616f-448f-bccd-ab6a74e1befd req-c2d24924-5a70-4253-96a2-b38a8e60c199 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-4de0dd57-616f-448f-bccd-ab6a74e1befd req-c2d24924-5a70-4253-96a2-b38a8e60c199 tempest-TestInstancesWithCinderVolumes-992173720 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-4594be7a-b6e8-4244-9440-252941ab923a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee02c73c-dd8d-43af-bca5-df9318e85357', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:20:22 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_a67c_jx1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107" returned: 0 in 3.060s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:22 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c5b6ff95-792c-4fb0-b8e7-dea90bc76834_a67c_jx1devstack@QuobyteHD, size 112.00 MB, duration 3.06 sec, destination /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107 {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:20:22 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Converted 112.00 MB image at 36.58 MB/s
Sep 28 18:20:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:22 devstack sudo[102139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107 1G
Sep 28 18:20:22 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:22 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-4de0dd57-616f-448f-bccd-ab6a74e1befd req-c2d24924-5a70-4253-96a2-b38a8e60c199 tempest-TestInstancesWithCinderVolumes-992173720 None] attachment_update completed successfully.
Sep 28 18:20:22 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107 1G" returned: 0 in 0.465s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:22 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Downloaded image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}])) to volume cc2d0ead-1322-4681-9ccd-237a71a2d107 successfully. {{(pid=87046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 28 18:20:22 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Temporary image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 for user 38b7294e7d544a55936c8098828f1afe is deleted. {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 28 18:20:22 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Marking volume cc2d0ead-1322-4681-9ccd-237a71a2d107 as bootable. {{(pid=87046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 28 18:20:22 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Copying metadata from image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 to cc2d0ead-1322-4681-9ccd-237a71a2d107. {{(pid=87046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 28 18:20:22 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Creating volume glance metadata for volume cc2d0ead-1322-4681-9ccd-237a71a2d107 backed by image c5b6ff95-792c-4fb0-b8e7-dea90bc76834 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 28 18:20:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a70f564-3a10-431a-b255-8471275f85a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc2d0ead-1322-4681-9ccd-237a71a2d107', 'volume_size': 1, 'image_id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de2452cfca174dfbbc7b50b163b23faa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5b6ff95-792c-4fb0-b8e7-dea90bc76834', 'created_at': datetime.datetime(2026, 9, 28, 15, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 58, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5b6ff95-792c-4fb0-b8e7-dea90bc76834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aa4a64fe0>}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f223ef71-14fa-47c1-822b-b4cf68ead6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:22 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Volume volume-cc2d0ead-1322-4681-9ccd-237a71a2d107 (cc2d0ead-1322-4681-9ccd-237a71a2d107): created successfully
Sep 28 18:20:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f223ef71-14fa-47c1-822b-b4cf68ead6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Flow 'volume_create_manager' (db287e49-8497-4032-9468-0e5a17fb3e40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:20:22 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-b7abfa28-34ad-4496-a760-9c253a2eb12b tempest-VolumesExtendTest-208114974 None] Created volume successfully.
Sep 28 18:20:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1fbf3135-385d-4295-9737-d915f7418dc9 tempest-VolumesExtendTest-208114974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1fbf3135-385d-4295-9737-d915f7418dc9 tempest-VolumesExtendTest-208114974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:23 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9b50f0-fcc9-4d97-8328-246c872790df]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1fbf3135-385d-4295-9737-d915f7418dc9 tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:23 devstack sudo[102152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107
Sep 28 18:20:23 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:23 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1fbf3135-385d-4295-9737-d915f7418dc9 tempest-VolumesExtendTest-208114974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107" returned: 0 in 0.542s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1fbf3135-385d-4295-9737-d915f7418dc9 tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107 2G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1fbf3135-385d-4295-9737-d915f7418dc9 tempest-VolumesExtendTest-208114974 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107 2G" returned: 0 in 0.142s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1fbf3135-385d-4295-9737-d915f7418dc9 tempest-VolumesExtendTest-208114974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.734s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:24 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-1fbf3135-385d-4295-9737-d915f7418dc9 tempest-VolumesExtendTest-208114974 None] Extend volume completed successfully.
Sep 28 18:20:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1a062f3c-10e6-4a2b-904a-287c44386b3f tempest-VolumesExtendTest-208114974 None] Acquiring lock "cinder-cc2d0ead-1322-4681-9ccd-237a71a2d107-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1a062f3c-10e6-4a2b-904a-287c44386b3f tempest-VolumesExtendTest-208114974 None] Lock "cinder-cc2d0ead-1322-4681-9ccd-237a71a2d107-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1a062f3c-10e6-4a2b-904a-287c44386b3f tempest-VolumesExtendTest-208114974 None] Acquiring lock "cinder-quobyte-cc2d0ead-1322-4681-9ccd-237a71a2d107" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1a062f3c-10e6-4a2b-904a-287c44386b3f tempest-VolumesExtendTest-208114974 None] Lock "cinder-quobyte-cc2d0ead-1322-4681-9ccd-237a71a2d107" acquired by "delete_volume" :: waited 0.030s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:25 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b6b643-0856-4a93-894d-0258b4250472]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1a062f3c-10e6-4a2b-904a-287c44386b3f tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:26 devstack sudo[102224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107
Sep 28 18:20:26 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:26 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1a062f3c-10e6-4a2b-904a-287c44386b3f tempest-VolumesExtendTest-208114974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107" returned: 0 in 0.549s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1a062f3c-10e6-4a2b-904a-287c44386b3f tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:26 devstack sudo[102242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107
Sep 28 18:20:26 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:26 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1a062f3c-10e6-4a2b-904a-287c44386b3f tempest-VolumesExtendTest-208114974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc2d0ead-1322-4681-9ccd-237a71a2d107" returned: 0 in 0.324s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:26 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1a062f3c-10e6-4a2b-904a-287c44386b3f tempest-VolumesExtendTest-208114974 None] Lock "cinder-quobyte-cc2d0ead-1322-4681-9ccd-237a71a2d107" released by "delete_volume" :: held 1.027s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:26 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-1a062f3c-10e6-4a2b-904a-287c44386b3f tempest-VolumesExtendTest-208114974 None] Created reservations ['711d367b-e037-4f74-bfc5-8d325dbd1134', '3bce495a-e4cf-4463-8759-ea61d87e50b9', '71f0aa67-6a26-4d7a-84d1-16ad374f2d40', '5dc75a87-e311-4490-a816-3d1289a51a47'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:20:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1a062f3c-10e6-4a2b-904a-287c44386b3f tempest-VolumesExtendTest-208114974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1a062f3c-10e6-4a2b-904a-287c44386b3f tempest-VolumesExtendTest-208114974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1a062f3c-10e6-4a2b-904a-287c44386b3f tempest-VolumesExtendTest-208114974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:20:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1a062f3c-10e6-4a2b-904a-287c44386b3f tempest-VolumesExtendTest-208114974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:20:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1a062f3c-10e6-4a2b-904a-287c44386b3f tempest-VolumesExtendTest-208114974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1a062f3c-10e6-4a2b-904a-287c44386b3f tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:27 devstack sudo[102260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:20:27 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:27 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1a062f3c-10e6-4a2b-904a-287c44386b3f tempest-VolumesExtendTest-208114974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.305s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:27 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-1a062f3c-10e6-4a2b-904a-287c44386b3f tempest-VolumesExtendTest-208114974 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:20:27 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-1a062f3c-10e6-4a2b-904a-287c44386b3f tempest-VolumesExtendTest-208114974 None] Deleted volume successfully.
Sep 28 18:20:27 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1a062f3c-10e6-4a2b-904a-287c44386b3f tempest-VolumesExtendTest-208114974 None] Lock "cinder-cc2d0ead-1322-4681-9ccd-237a71a2d107-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:28 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:20:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Flow 'volume_create_manager' (12c4c43c-638a-4d6e-9cd4-7c696e00625d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:20:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa712f8-804e-4ce1-b15e-c1490aa932bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa712f8-804e-4ce1-b15e-c1490aa932bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1223399345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05afaf1-95d7-4596-b663-59641899812d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='536d3a7fa9304d879aea712fe124036e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:29Z,use_quota=True,user_id='38b7294e7d544a55936c8098828f1afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b3368d-242c-447a-9fda-6ec7b7866f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b3368d-242c-447a-9fda-6ec7b7866f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3bb6f4-6f56-4af7-b57b-8a4c47838e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3bb6f4-6f56-4af7-b57b-8a4c47838e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b05afaf1-95d7-4596-b663-59641899812d', 'volume_name': 'volume-b05afaf1-95d7-4596-b663-59641899812d', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6901a74a-83c5-4830-bade-d5e6711e9a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6901a74a-83c5-4830-bade-d5e6711e9a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f1e51a-28f8-486f-b5af-de35290656ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:28 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Volume b05afaf1-95d7-4596-b663-59641899812d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b05afaf1-95d7-4596-b663-59641899812d', 'volume_size': 1}
Sep 28 18:20:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:28 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1223399345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05afaf1-95d7-4596-b663-59641899812d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='536d3a7fa9304d879aea712fe124036e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:29Z,use_quota=True,user_id='38b7294e7d544a55936c8098828f1afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:20:28 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Creating volume b05afaf1-95d7-4596-b663-59641899812d {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:20:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:28 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:20:28 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:20:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:28 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:20:28 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:20:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:28 devstack sudo[102320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d 1073741824
Sep 28 18:20:28 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:29 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d 1073741824" returned: 0 in 0.870s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:29 devstack sudo[102329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d
Sep 28 18:20:29 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:30 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-1d5f2bb3-5152-446c-a08e-c6dd7817ecdc req-274d4492-cf26-4ea9-a56c-910acd9686d6 tempest-TestInstancesWithCinderVolumes-992173720 None] Terminate volume connection completed successfully.
Sep 28 18:20:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-1d5f2bb3-5152-446c-a08e-c6dd7817ecdc req-274d4492-cf26-4ea9-a56c-910acd9686d6 tempest-TestInstancesWithCinderVolumes-992173720 None] Deleting attachment 04ea5d54-dfd6-4faa-be01-d4d4481d37a0. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:20:30 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d" returned: 0 in 0.431s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:20:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f1e51a-28f8-486f-b5af-de35290656ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b05afaf1-95d7-4596-b663-59641899812d', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc2c974-5b91-4397-8ae8-63802a25f0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:30 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Volume volume-b05afaf1-95d7-4596-b663-59641899812d (b05afaf1-95d7-4596-b663-59641899812d): created successfully
Sep 28 18:20:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc2c974-5b91-4397-8ae8-63802a25f0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Flow 'volume_create_manager' (12c4c43c-638a-4d6e-9cd4-7c696e00625d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:20:30 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-5d53b7f6-fb43-40e8-b95d-20feefb94e7c tempest-VolumesExtendTest-208114974 None] Created volume successfully.
Sep 28 18:20:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b9efbccc-fa02-4eb6-acec-49b86d699738 tempest-VolumesExtendTest-208114974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b9efbccc-fa02-4eb6-acec-49b86d699738 tempest-VolumesExtendTest-208114974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:31 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-b9efbccc-fa02-4eb6-acec-49b86d699738 tempest-VolumesExtendTest-208114974 None] Creating offline snapshot a054a96a-0168-4287-998c-5b239f810e01 of volume b05afaf1-95d7-4596-b663-59641899812d {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:20:31 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b428505-031c-40bf-b9ab-f0ade2609706]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b9efbccc-fa02-4eb6-acec-49b86d699738 tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:31 devstack sudo[102361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d
Sep 28 18:20:31 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:31 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b9efbccc-fa02-4eb6-acec-49b86d699738 tempest-VolumesExtendTest-208114974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d" returned: 0 in 0.619s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b9efbccc-fa02-4eb6-acec-49b86d699738 tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.a054a96a-0168-4287-998c-5b239f810e01 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:31 devstack sudo[102369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.a054a96a-0168-4287-998c-5b239f810e01 1G
Sep 28 18:20:31 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-998b0888-94fb-4f5f-91f7-ca8e89ece3e3 tempest-TestInstancesWithCinderVolumes-992173720 None] Acquiring lock "cinder-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:31 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:31 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-998b0888-94fb-4f5f-91f7-ca8e89ece3e3 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "cinder-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:32 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-998b0888-94fb-4f5f-91f7-ca8e89ece3e3 tempest-TestInstancesWithCinderVolumes-992173720 None] Acquiring lock "cinder-quobyte-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:32 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-998b0888-94fb-4f5f-91f7-ca8e89ece3e3 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "cinder-quobyte-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01" acquired by "delete_volume" :: waited 0.024s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:32 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[db11ed6c-ef0e-44b6-8042-f5ed82a4dbb9]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-998b0888-94fb-4f5f-91f7-ca8e89ece3e3 tempest-TestInstancesWithCinderVolumes-992173720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:32 devstack sudo[102375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01
Sep 28 18:20:32 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:32 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b9efbccc-fa02-4eb6-acec-49b86d699738 tempest-VolumesExtendTest-208114974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.a054a96a-0168-4287-998c-5b239f810e01 1G" returned: 0 in 0.682s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b9efbccc-fa02-4eb6-acec-49b86d699738 tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b05afaf1-95d7-4596-b663-59641899812d -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.a054a96a-0168-4287-998c-5b239f810e01 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:32 devstack sudo[102383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b05afaf1-95d7-4596-b663-59641899812d -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.a054a96a-0168-4287-998c-5b239f810e01
Sep 28 18:20:32 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:32 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-998b0888-94fb-4f5f-91f7-ca8e89ece3e3 tempest-TestInstancesWithCinderVolumes-992173720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01" returned: 0 in 0.596s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-998b0888-94fb-4f5f-91f7-ca8e89ece3e3 tempest-TestInstancesWithCinderVolumes-992173720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:32 devstack sudo[102387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01
Sep 28 18:20:32 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:33 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b9efbccc-fa02-4eb6-acec-49b86d699738 tempest-VolumesExtendTest-208114974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b05afaf1-95d7-4596-b663-59641899812d -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.a054a96a-0168-4287-998c-5b239f810e01" returned: 0 in 0.502s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:33 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-b9efbccc-fa02-4eb6-acec-49b86d699738 tempest-VolumesExtendTest-208114974 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.a054a96a-0168-4287-998c-5b239f810e01 is being set with open permissions: ugo+rw
Sep 28 18:20:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b9efbccc-fa02-4eb6-acec-49b86d699738 tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.a054a96a-0168-4287-998c-5b239f810e01 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:33 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-998b0888-94fb-4f5f-91f7-ca8e89ece3e3 tempest-TestInstancesWithCinderVolumes-992173720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01" returned: 0 in 0.413s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:33 devstack sudo[102395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.a054a96a-0168-4287-998c-5b239f810e01
Sep 28 18:20:33 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:33 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-998b0888-94fb-4f5f-91f7-ca8e89ece3e3 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "cinder-quobyte-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01" released by "delete_volume" :: held 1.087s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:33 devstack cinder-volume[87046]: WARNING cinder.quota [None req-998b0888-94fb-4f5f-91f7-ca8e89ece3e3 tempest-TestInstancesWithCinderVolumes-992173720 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1661977196-2117625267 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1661977196-2117625267, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:20:33 devstack cinder-volume[87046]: WARNING cinder.quota [None req-998b0888-94fb-4f5f-91f7-ca8e89ece3e3 tempest-TestInstancesWithCinderVolumes-992173720 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1661977196-2117625267 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1661977196-2117625267, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:20:33 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-998b0888-94fb-4f5f-91f7-ca8e89ece3e3 tempest-TestInstancesWithCinderVolumes-992173720 None] Created reservations ['2a9deba8-7bf2-4acc-badb-37e33e74f593', '92040c82-ad15-4600-850d-359d9da0c245', '884ccd21-4218-4512-9eb8-29c4521e83f7', 'ec62c617-fa90-4978-8732-8cf39db7f6c2'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:20:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-998b0888-94fb-4f5f-91f7-ca8e89ece3e3 tempest-TestInstancesWithCinderVolumes-992173720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-998b0888-94fb-4f5f-91f7-ca8e89ece3e3 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-998b0888-94fb-4f5f-91f7-ca8e89ece3e3 tempest-TestInstancesWithCinderVolumes-992173720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:20:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-998b0888-94fb-4f5f-91f7-ca8e89ece3e3 tempest-TestInstancesWithCinderVolumes-992173720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:20:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-998b0888-94fb-4f5f-91f7-ca8e89ece3e3 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-998b0888-94fb-4f5f-91f7-ca8e89ece3e3 tempest-TestInstancesWithCinderVolumes-992173720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:33 devstack sudo[102397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:20:33 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:33 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b9efbccc-fa02-4eb6-acec-49b86d699738 tempest-VolumesExtendTest-208114974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.a054a96a-0168-4287-998c-5b239f810e01" returned: 0 in 0.344s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b9efbccc-fa02-4eb6-acec-49b86d699738 tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:33 devstack sudo[102400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.info
Sep 28 18:20:33 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:33 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-998b0888-94fb-4f5f-91f7-ca8e89ece3e3 tempest-TestInstancesWithCinderVolumes-992173720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.291s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:33 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-998b0888-94fb-4f5f-91f7-ca8e89ece3e3 tempest-TestInstancesWithCinderVolumes-992173720 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:20:33 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-998b0888-94fb-4f5f-91f7-ca8e89ece3e3 tempest-TestInstancesWithCinderVolumes-992173720 None] Deleted volume successfully.
Sep 28 18:20:33 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-998b0888-94fb-4f5f-91f7-ca8e89ece3e3 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "cinder-ff900d6f-a6c3-43eb-aa8e-1b68b6424f01-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:33 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b9efbccc-fa02-4eb6-acec-49b86d699738 tempest-VolumesExtendTest-208114974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.info" returned: 0 in 0.352s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:33 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-b9efbccc-fa02-4eb6-acec-49b86d699738 tempest-VolumesExtendTest-208114974 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.info is being set with open permissions: ugo+rw
Sep 28 18:20:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b9efbccc-fa02-4eb6-acec-49b86d699738 tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:33 devstack sudo[102404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.info
Sep 28 18:20:33 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:34 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b9efbccc-fa02-4eb6-acec-49b86d699738 tempest-VolumesExtendTest-208114974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.info" returned: 0 in 0.318s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b9efbccc-fa02-4eb6-acec-49b86d699738 tempest-VolumesExtendTest-208114974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.968s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:34 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-b9efbccc-fa02-4eb6-acec-49b86d699738 tempest-VolumesExtendTest-208114974 None] Create snapshot completed successfully
Sep 28 18:20:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d4eae887-c7e1-4e23-9fd0-7eb8dbe58881 tempest-VolumesExtendTest-208114974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d4eae887-c7e1-4e23-9fd0-7eb8dbe58881 tempest-VolumesExtendTest-208114974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:34 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe74cd56-8e94-414a-b37e-d8b7c0f7cc86]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d4eae887-c7e1-4e23-9fd0-7eb8dbe58881 tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:34 devstack sudo[102407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d
Sep 28 18:20:34 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:35 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d4eae887-c7e1-4e23-9fd0-7eb8dbe58881 tempest-VolumesExtendTest-208114974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d" returned: 0 in 0.544s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d4eae887-c7e1-4e23-9fd0-7eb8dbe58881 tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.a054a96a-0168-4287-998c-5b239f810e01 2G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d4eae887-c7e1-4e23-9fd0-7eb8dbe58881 tempest-VolumesExtendTest-208114974 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.a054a96a-0168-4287-998c-5b239f810e01 2G" returned: 0 in 0.190s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d4eae887-c7e1-4e23-9fd0-7eb8dbe58881 tempest-VolumesExtendTest-208114974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.792s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:35 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d4eae887-c7e1-4e23-9fd0-7eb8dbe58881 tempest-VolumesExtendTest-208114974 None] Extend volume completed successfully.
Sep 28 18:20:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2d6eebbc-db85-4efc-ba19-272c020e402c tempest-VolumesExtendTest-208114974 None] Acquiring lock "cinder-a054a96a-0168-4287-998c-5b239f810e01-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2d6eebbc-db85-4efc-ba19-272c020e402c tempest-VolumesExtendTest-208114974 None] Lock "cinder-a054a96a-0168-4287-998c-5b239f810e01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2d6eebbc-db85-4efc-ba19-272c020e402c tempest-VolumesExtendTest-208114974 None] Acquiring lock "cinder-quobyte-b05afaf1-95d7-4596-b663-59641899812d" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2d6eebbc-db85-4efc-ba19-272c020e402c tempest-VolumesExtendTest-208114974 None] Lock "cinder-quobyte-b05afaf1-95d7-4596-b663-59641899812d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2d6eebbc-db85-4efc-ba19-272c020e402c tempest-VolumesExtendTest-208114974 None] Acquiring lock "cinder-quobyte-a054a96a-0168-4287-998c-5b239f810e01" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2d6eebbc-db85-4efc-ba19-272c020e402c tempest-VolumesExtendTest-208114974 None] Lock "cinder-quobyte-a054a96a-0168-4287-998c-5b239f810e01" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-2d6eebbc-db85-4efc-ba19-272c020e402c tempest-VolumesExtendTest-208114974 None] Deleting offline snapshot a054a96a-0168-4287-998c-5b239f810e01 of volume b05afaf1-95d7-4596-b663-59641899812d {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:20:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-2d6eebbc-db85-4efc-ba19-272c020e402c tempest-VolumesExtendTest-208114974 None] snapshot_file for this snap is: volume-b05afaf1-95d7-4596-b663-59641899812d.a054a96a-0168-4287-998c-5b239f810e01 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:20:36 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89bd4b8-89c3-4197-9f18-d79a89bad02d]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2d6eebbc-db85-4efc-ba19-272c020e402c tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.a054a96a-0168-4287-998c-5b239f810e01 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:36 devstack sudo[102440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.a054a96a-0168-4287-998c-5b239f810e01
Sep 28 18:20:36 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:36 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2d6eebbc-db85-4efc-ba19-272c020e402c tempest-VolumesExtendTest-208114974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.a054a96a-0168-4287-998c-5b239f810e01" returned: 0 in 0.520s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-2d6eebbc-db85-4efc-ba19-272c020e402c tempest-VolumesExtendTest-208114974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b05afaf1-95d7-4596-b663-59641899812d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:20:36 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd09f1fe-882d-4157-acae-db7d68e44f04]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2d6eebbc-db85-4efc-ba19-272c020e402c tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:36 devstack sudo[102447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d
Sep 28 18:20:36 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:36 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-f13b8194-4074-43af-b036-5afd6c06b2f1 req-6202be80-d81e-4bd0-a61a-c6c3d263b30c tempest-TestInstancesWithCinderVolumes-992173720 None] Terminate volume connection completed successfully.
Sep 28 18:20:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-f13b8194-4074-43af-b036-5afd6c06b2f1 req-6202be80-d81e-4bd0-a61a-c6c3d263b30c tempest-TestInstancesWithCinderVolumes-992173720 None] Deleting attachment ee02c73c-dd8d-43af-bca5-df9318e85357. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:20:37 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2d6eebbc-db85-4efc-ba19-272c020e402c tempest-VolumesExtendTest-208114974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d" returned: 0 in 0.580s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2d6eebbc-db85-4efc-ba19-272c020e402c tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.a054a96a-0168-4287-998c-5b239f810e01 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:37 devstack sudo[102456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.a054a96a-0168-4287-998c-5b239f810e01
Sep 28 18:20:37 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6b456013-4943-4ed8-92ce-9cd80ae94a81 tempest-TestInstancesWithCinderVolumes-992173720 None] Acquiring lock "cinder-4594be7a-b6e8-4244-9440-252941ab923a-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6b456013-4943-4ed8-92ce-9cd80ae94a81 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "cinder-4594be7a-b6e8-4244-9440-252941ab923a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6b456013-4943-4ed8-92ce-9cd80ae94a81 tempest-TestInstancesWithCinderVolumes-992173720 None] Acquiring lock "cinder-quobyte-4594be7a-b6e8-4244-9440-252941ab923a" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6b456013-4943-4ed8-92ce-9cd80ae94a81 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "cinder-quobyte-4594be7a-b6e8-4244-9440-252941ab923a" acquired by "delete_volume" :: waited 0.036s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:37 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c1537f-fc00-4ce4-9d9d-8cfaf1ba9602]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6b456013-4943-4ed8-92ce-9cd80ae94a81 tempest-TestInstancesWithCinderVolumes-992173720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4594be7a-b6e8-4244-9440-252941ab923a {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:37 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2d6eebbc-db85-4efc-ba19-272c020e402c tempest-VolumesExtendTest-208114974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.a054a96a-0168-4287-998c-5b239f810e01" returned: 0 in 0.510s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2d6eebbc-db85-4efc-ba19-272c020e402c tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.a054a96a-0168-4287-998c-5b239f810e01 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:37 devstack sudo[102463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.a054a96a-0168-4287-998c-5b239f810e01
Sep 28 18:20:37 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:37 devstack sudo[102462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4594be7a-b6e8-4244-9440-252941ab923a
Sep 28 18:20:37 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:38 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2d6eebbc-db85-4efc-ba19-272c020e402c tempest-VolumesExtendTest-208114974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d.a054a96a-0168-4287-998c-5b239f810e01" returned: 0 in 0.354s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2d6eebbc-db85-4efc-ba19-272c020e402c tempest-VolumesExtendTest-208114974 None] Lock "cinder-quobyte-a054a96a-0168-4287-998c-5b239f810e01" released by "_delete_snapshot" :: held 2.130s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2d6eebbc-db85-4efc-ba19-272c020e402c tempest-VolumesExtendTest-208114974 None] Lock "cinder-quobyte-b05afaf1-95d7-4596-b663-59641899812d" released by "delete_snapshot" :: held 2.160s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:38 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6b456013-4943-4ed8-92ce-9cd80ae94a81 tempest-TestInstancesWithCinderVolumes-992173720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4594be7a-b6e8-4244-9440-252941ab923a" returned: 0 in 0.535s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6b456013-4943-4ed8-92ce-9cd80ae94a81 tempest-TestInstancesWithCinderVolumes-992173720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4594be7a-b6e8-4244-9440-252941ab923a {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:38 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-2d6eebbc-db85-4efc-ba19-272c020e402c tempest-VolumesExtendTest-208114974 None] Created reservations ['759ab23d-4dae-4535-9ce3-07b0aba791bd', 'e43e9068-cefd-4044-bc1f-5f2ccd6c7907', 'e6692b24-1b8f-4a6e-9480-9fadcc053f69', 'bc8b86e1-8402-4a31-8c02-93f8329b2f09'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:20:38 devstack sudo[102471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4594be7a-b6e8-4244-9440-252941ab923a
Sep 28 18:20:38 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:38 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-2d6eebbc-db85-4efc-ba19-272c020e402c tempest-VolumesExtendTest-208114974 None] Delete snapshot completed successfully.
Sep 28 18:20:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2d6eebbc-db85-4efc-ba19-272c020e402c tempest-VolumesExtendTest-208114974 None] Lock "cinder-a054a96a-0168-4287-998c-5b239f810e01-delete_snapshot" released by "delete_snapshot" :: held 2.413s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:38 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6b456013-4943-4ed8-92ce-9cd80ae94a81 tempest-TestInstancesWithCinderVolumes-992173720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4594be7a-b6e8-4244-9440-252941ab923a" returned: 0 in 0.358s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6b456013-4943-4ed8-92ce-9cd80ae94a81 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "cinder-quobyte-4594be7a-b6e8-4244-9440-252941ab923a" released by "delete_volume" :: held 0.972s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:38 devstack cinder-volume[87046]: WARNING cinder.quota [None req-6b456013-4943-4ed8-92ce-9cd80ae94a81 tempest-TestInstancesWithCinderVolumes-992173720 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-20938239-1616102876 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-20938239-1616102876, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:20:38 devstack cinder-volume[87046]: WARNING cinder.quota [None req-6b456013-4943-4ed8-92ce-9cd80ae94a81 tempest-TestInstancesWithCinderVolumes-992173720 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-20938239-1616102876 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-20938239-1616102876, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:20:38 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-6b456013-4943-4ed8-92ce-9cd80ae94a81 tempest-TestInstancesWithCinderVolumes-992173720 None] Created reservations ['ccd290d7-f003-4ce3-92be-703b41209819', 'bfb67d9a-75a2-492e-bf69-5aaa039caf84', '123cd878-b6f4-4ec1-9985-7494ccd3f49e', 'efdcbd51-01ca-401a-a215-89690308370c'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:20:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6b456013-4943-4ed8-92ce-9cd80ae94a81 tempest-TestInstancesWithCinderVolumes-992173720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6b456013-4943-4ed8-92ce-9cd80ae94a81 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:38 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6b456013-4943-4ed8-92ce-9cd80ae94a81 tempest-TestInstancesWithCinderVolumes-992173720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:20:38 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6b456013-4943-4ed8-92ce-9cd80ae94a81 tempest-TestInstancesWithCinderVolumes-992173720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:20:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6b456013-4943-4ed8-92ce-9cd80ae94a81 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6b456013-4943-4ed8-92ce-9cd80ae94a81 tempest-TestInstancesWithCinderVolumes-992173720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:38 devstack sudo[102474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:20:38 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:39 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6b456013-4943-4ed8-92ce-9cd80ae94a81 tempest-TestInstancesWithCinderVolumes-992173720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.363s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-6b456013-4943-4ed8-92ce-9cd80ae94a81 tempest-TestInstancesWithCinderVolumes-992173720 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:20:39 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-6b456013-4943-4ed8-92ce-9cd80ae94a81 tempest-TestInstancesWithCinderVolumes-992173720 None] Deleted volume successfully.
Sep 28 18:20:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6b456013-4943-4ed8-92ce-9cd80ae94a81 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "cinder-4594be7a-b6e8-4244-9440-252941ab923a-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c4c65bb1-f8de-430f-b788-4cff924135e0 tempest-VolumesExtendTest-208114974 None] Acquiring lock "cinder-b05afaf1-95d7-4596-b663-59641899812d-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c4c65bb1-f8de-430f-b788-4cff924135e0 tempest-VolumesExtendTest-208114974 None] Lock "cinder-b05afaf1-95d7-4596-b663-59641899812d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:20:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:20:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:20:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:39 devstack sudo[102478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:20:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c4c65bb1-f8de-430f-b788-4cff924135e0 tempest-VolumesExtendTest-208114974 None] Acquiring lock "cinder-quobyte-b05afaf1-95d7-4596-b663-59641899812d" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:39 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c4c65bb1-f8de-430f-b788-4cff924135e0 tempest-VolumesExtendTest-208114974 None] Lock "cinder-quobyte-b05afaf1-95d7-4596-b663-59641899812d" acquired by "delete_volume" :: waited 0.035s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:39 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[948db5b8-d260-4e97-89c3-b142c65e0c04]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c4c65bb1-f8de-430f-b788-4cff924135e0 tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:39 devstack sudo[102480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d
Sep 28 18:20:39 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:40 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.718s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:40 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:20:40 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:20:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:20:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:20:40 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c4c65bb1-f8de-430f-b788-4cff924135e0 tempest-VolumesExtendTest-208114974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d" returned: 0 in 0.697s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c4c65bb1-f8de-430f-b788-4cff924135e0 tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:40 devstack sudo[102486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d
Sep 28 18:20:40 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:40 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c4c65bb1-f8de-430f-b788-4cff924135e0 tempest-VolumesExtendTest-208114974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b05afaf1-95d7-4596-b663-59641899812d" returned: 0 in 0.433s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c4c65bb1-f8de-430f-b788-4cff924135e0 tempest-VolumesExtendTest-208114974 None] Lock "cinder-quobyte-b05afaf1-95d7-4596-b663-59641899812d" released by "delete_volume" :: held 1.273s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:40 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-c4c65bb1-f8de-430f-b788-4cff924135e0 tempest-VolumesExtendTest-208114974 None] Created reservations ['23aac1a5-9e1f-42d7-beb5-e9e74230ecd9', 'dbc6d1f1-e075-475f-9eaf-36831a4a634b', '168fe0e3-37e0-4c4e-84cc-3a532febb61d', '141584f4-adc0-4df6-8699-64bf83e6d2d9'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:20:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c4c65bb1-f8de-430f-b788-4cff924135e0 tempest-VolumesExtendTest-208114974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c4c65bb1-f8de-430f-b788-4cff924135e0 tempest-VolumesExtendTest-208114974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c4c65bb1-f8de-430f-b788-4cff924135e0 tempest-VolumesExtendTest-208114974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:20:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c4c65bb1-f8de-430f-b788-4cff924135e0 tempest-VolumesExtendTest-208114974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:20:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c4c65bb1-f8de-430f-b788-4cff924135e0 tempest-VolumesExtendTest-208114974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c4c65bb1-f8de-430f-b788-4cff924135e0 tempest-VolumesExtendTest-208114974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:41 devstack sudo[102489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:20:41 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:41 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c4c65bb1-f8de-430f-b788-4cff924135e0 tempest-VolumesExtendTest-208114974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.391s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:41 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-c4c65bb1-f8de-430f-b788-4cff924135e0 tempest-VolumesExtendTest-208114974 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:20:41 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-c4c65bb1-f8de-430f-b788-4cff924135e0 tempest-VolumesExtendTest-208114974 None] Deleted volume successfully.
Sep 28 18:20:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c4c65bb1-f8de-430f-b788-4cff924135e0 tempest-VolumesExtendTest-208114974 None] Lock "cinder-b05afaf1-95d7-4596-b663-59641899812d-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-83e313ec-de16-493b-905d-a8e320933abe tempest-VolumesNegativeTest-15521259 None] Acquiring lock "cinder-47b64ec2-151d-405f-80cd-9e6d9dae0fa9-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-83e313ec-de16-493b-905d-a8e320933abe tempest-VolumesNegativeTest-15521259 None] Lock "cinder-47b64ec2-151d-405f-80cd-9e6d9dae0fa9-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-83e313ec-de16-493b-905d-a8e320933abe tempest-VolumesNegativeTest-15521259 None] Acquiring lock "cinder-quobyte-47b64ec2-151d-405f-80cd-9e6d9dae0fa9" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-83e313ec-de16-493b-905d-a8e320933abe tempest-VolumesNegativeTest-15521259 None] Lock "cinder-quobyte-47b64ec2-151d-405f-80cd-9e6d9dae0fa9" acquired by "delete_volume" :: waited 0.044s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:42 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6feb16f5-cccc-4dfe-ad4b-58ae87ea49fa]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-83e313ec-de16-493b-905d-a8e320933abe tempest-VolumesNegativeTest-15521259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47b64ec2-151d-405f-80cd-9e6d9dae0fa9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:42 devstack sudo[102519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47b64ec2-151d-405f-80cd-9e6d9dae0fa9
Sep 28 18:20:42 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:43 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-83e313ec-de16-493b-905d-a8e320933abe tempest-VolumesNegativeTest-15521259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47b64ec2-151d-405f-80cd-9e6d9dae0fa9" returned: 0 in 0.568s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-83e313ec-de16-493b-905d-a8e320933abe tempest-VolumesNegativeTest-15521259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47b64ec2-151d-405f-80cd-9e6d9dae0fa9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:43 devstack sudo[102526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47b64ec2-151d-405f-80cd-9e6d9dae0fa9
Sep 28 18:20:43 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:43 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-83e313ec-de16-493b-905d-a8e320933abe tempest-VolumesNegativeTest-15521259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-47b64ec2-151d-405f-80cd-9e6d9dae0fa9" returned: 0 in 0.297s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-83e313ec-de16-493b-905d-a8e320933abe tempest-VolumesNegativeTest-15521259 None] Lock "cinder-quobyte-47b64ec2-151d-405f-80cd-9e6d9dae0fa9" released by "delete_volume" :: held 0.959s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:43 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-83e313ec-de16-493b-905d-a8e320933abe tempest-VolumesNegativeTest-15521259 None] Created reservations ['f8fc2bb3-0bd9-43b9-a5f5-bbbf86b9558f', '135ceca5-bf26-45a1-b80f-47f25e867903', '4fef817c-2525-4bd5-a383-01d86f957303', '925d0ecd-bce7-4d74-aed4-448f6a542bfd'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:20:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-83e313ec-de16-493b-905d-a8e320933abe tempest-VolumesNegativeTest-15521259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-83e313ec-de16-493b-905d-a8e320933abe tempest-VolumesNegativeTest-15521259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-83e313ec-de16-493b-905d-a8e320933abe tempest-VolumesNegativeTest-15521259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:20:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-83e313ec-de16-493b-905d-a8e320933abe tempest-VolumesNegativeTest-15521259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:20:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-83e313ec-de16-493b-905d-a8e320933abe tempest-VolumesNegativeTest-15521259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-83e313ec-de16-493b-905d-a8e320933abe tempest-VolumesNegativeTest-15521259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:43 devstack sudo[102530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:20:43 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:44 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-12ff77d0-5597-4478-80da-de9f0e95fb2d req-a5edd9fe-8839-490e-a342-94e7cdf0aed9 tempest-TestInstancesWithCinderVolumes-992173720 None] Terminate volume connection completed successfully.
Sep 28 18:20:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-12ff77d0-5597-4478-80da-de9f0e95fb2d req-a5edd9fe-8839-490e-a342-94e7cdf0aed9 tempest-TestInstancesWithCinderVolumes-992173720 None] Deleting attachment 6d52c1c0-b608-45ef-9e74-5a47a82fc1bd. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:20:44 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-83e313ec-de16-493b-905d-a8e320933abe tempest-VolumesNegativeTest-15521259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.391s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:44 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-83e313ec-de16-493b-905d-a8e320933abe tempest-VolumesNegativeTest-15521259 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:20:44 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-83e313ec-de16-493b-905d-a8e320933abe tempest-VolumesNegativeTest-15521259 None] Deleted volume successfully.
Sep 28 18:20:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-83e313ec-de16-493b-905d-a8e320933abe tempest-VolumesNegativeTest-15521259 None] Lock "cinder-47b64ec2-151d-405f-80cd-9e6d9dae0fa9-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d5f151fd-535e-49b3-aaa8-8cb5270b7dd3 tempest-TestInstancesWithCinderVolumes-992173720 None] Acquiring lock "cinder-5ff682bb-d526-40ce-ab25-afb0e4f1f871-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d5f151fd-535e-49b3-aaa8-8cb5270b7dd3 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "cinder-5ff682bb-d526-40ce-ab25-afb0e4f1f871-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d5f151fd-535e-49b3-aaa8-8cb5270b7dd3 tempest-TestInstancesWithCinderVolumes-992173720 None] Acquiring lock "cinder-quobyte-5ff682bb-d526-40ce-ab25-afb0e4f1f871" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d5f151fd-535e-49b3-aaa8-8cb5270b7dd3 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "cinder-quobyte-5ff682bb-d526-40ce-ab25-afb0e4f1f871" acquired by "delete_volume" :: waited 0.018s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:45 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[552bbbc4-e1af-45de-89e0-f422d7a658f6]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d5f151fd-535e-49b3-aaa8-8cb5270b7dd3 tempest-TestInstancesWithCinderVolumes-992173720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:45 devstack sudo[102535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871
Sep 28 18:20:45 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:46 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d5f151fd-535e-49b3-aaa8-8cb5270b7dd3 tempest-TestInstancesWithCinderVolumes-992173720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871" returned: 0 in 0.613s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d5f151fd-535e-49b3-aaa8-8cb5270b7dd3 tempest-TestInstancesWithCinderVolumes-992173720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:46 devstack sudo[102540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871
Sep 28 18:20:46 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:46 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d5f151fd-535e-49b3-aaa8-8cb5270b7dd3 tempest-TestInstancesWithCinderVolumes-992173720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5ff682bb-d526-40ce-ab25-afb0e4f1f871" returned: 0 in 0.339s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d5f151fd-535e-49b3-aaa8-8cb5270b7dd3 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "cinder-quobyte-5ff682bb-d526-40ce-ab25-afb0e4f1f871" released by "delete_volume" :: held 1.009s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:46 devstack cinder-volume[87046]: WARNING cinder.quota [None req-d5f151fd-535e-49b3-aaa8-8cb5270b7dd3 tempest-TestInstancesWithCinderVolumes-992173720 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-497704478-220144875 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-497704478-220144875, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:20:46 devstack cinder-volume[87046]: WARNING cinder.quota [None req-d5f151fd-535e-49b3-aaa8-8cb5270b7dd3 tempest-TestInstancesWithCinderVolumes-992173720 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-497704478-220144875 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-497704478-220144875, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:20:46 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-d5f151fd-535e-49b3-aaa8-8cb5270b7dd3 tempest-TestInstancesWithCinderVolumes-992173720 None] Created reservations ['41e32a04-cbcd-4c2a-9baf-b3f972d84150', 'bbce909f-680a-4dc9-8484-8a677daa4020', 'd0346186-72da-48a7-8a2e-af62a8caa86c', '0181ef2d-193b-4bd7-b10e-9218f438a9cd'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:20:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d5f151fd-535e-49b3-aaa8-8cb5270b7dd3 tempest-TestInstancesWithCinderVolumes-992173720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d5f151fd-535e-49b3-aaa8-8cb5270b7dd3 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d5f151fd-535e-49b3-aaa8-8cb5270b7dd3 tempest-TestInstancesWithCinderVolumes-992173720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:20:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d5f151fd-535e-49b3-aaa8-8cb5270b7dd3 tempest-TestInstancesWithCinderVolumes-992173720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:20:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d5f151fd-535e-49b3-aaa8-8cb5270b7dd3 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d5f151fd-535e-49b3-aaa8-8cb5270b7dd3 tempest-TestInstancesWithCinderVolumes-992173720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:46 devstack sudo[102543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:20:46 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:47 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d5f151fd-535e-49b3-aaa8-8cb5270b7dd3 tempest-TestInstancesWithCinderVolumes-992173720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.415s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:47 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d5f151fd-535e-49b3-aaa8-8cb5270b7dd3 tempest-TestInstancesWithCinderVolumes-992173720 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:20:47 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d5f151fd-535e-49b3-aaa8-8cb5270b7dd3 tempest-TestInstancesWithCinderVolumes-992173720 None] Deleted volume successfully.
Sep 28 18:20:47 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d5f151fd-535e-49b3-aaa8-8cb5270b7dd3 tempest-TestInstancesWithCinderVolumes-992173720 None] Lock "cinder-5ff682bb-d526-40ce-ab25-afb0e4f1f871-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:48 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:20:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Flow 'volume_create_manager' (5e330bda-b707-4da4-97c4-44e67fc06b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:20:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec2f921-3cd7-476c-9244-f5af830ba42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec2f921-3cd7-476c-9244-f5af830ba42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1101193667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1977031a-f15a-4a4a-8de5-9e07fb241f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3da7875604ab42329bbbe44d3040700c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:48Z,use_quota=True,user_id='2aa7f71f583a438e81bd74f01c5dba2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6de250-612d-4d74-8e4f-d43be5334591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6de250-612d-4d74-8e4f-d43be5334591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (252cbbe7-5c42-4a11-8d2f-4917acfe0a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (252cbbe7-5c42-4a11-8d2f-4917acfe0a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1977031a-f15a-4a4a-8de5-9e07fb241f91', 'volume_name': 'volume-1977031a-f15a-4a4a-8de5-9e07fb241f91', 'volume_size': 2}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5590d541-166f-4c42-91ce-6fcf10f24b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5590d541-166f-4c42-91ce-6fcf10f24b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a91ed349-07a2-4775-a576-e7f5e41f480d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:48 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Volume 1977031a-f15a-4a4a-8de5-9e07fb241f91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1977031a-f15a-4a4a-8de5-9e07fb241f91', 'volume_size': 2}
Sep 28 18:20:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:48 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1101193667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1977031a-f15a-4a4a-8de5-9e07fb241f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3da7875604ab42329bbbe44d3040700c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:48Z,use_quota=True,user_id='2aa7f71f583a438e81bd74f01c5dba2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:20:48 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Creating volume 1977031a-f15a-4a4a-8de5-9e07fb241f91 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:20:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:48 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:20:48 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:20:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:48 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:20:48 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:20:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91 2147483648 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:48 devstack sudo[102546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91 2147483648
Sep 28 18:20:48 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:49 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91 2147483648" returned: 0 in 0.643s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:49 devstack sudo[102552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91
Sep 28 18:20:49 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:49 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91" returned: 0 in 0.376s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a91ed349-07a2-4775-a576-e7f5e41f480d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1977031a-f15a-4a4a-8de5-9e07fb241f91', 'volume_size': 2}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106c3103-4537-4f1a-8017-d93880151eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:49 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Volume volume-1977031a-f15a-4a4a-8de5-9e07fb241f91 (1977031a-f15a-4a4a-8de5-9e07fb241f91): created successfully
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106c3103-4537-4f1a-8017-d93880151eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Flow 'volume_create_manager' (5e330bda-b707-4da4-97c4-44e67fc06b67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:20:49 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-9d83969b-8d90-4c36-a498-3fff680203fa tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Created volume successfully.
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Flow 'volume_create_manager' (d03bb615-d076-4b84-94f8-e2621b003b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b79ca8-7783-44fd-9116-e0b564b4e67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b79ca8-7783-44fd-9116-e0b564b4e67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-255621548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=defafa74-6762-4332-aebe-28b6789824d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbba2e13fc37450fa5f33e963fe2010d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:50Z,use_quota=True,user_id='fcda2a67783a40f8b1f6c6d59f7238ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cca6444-055a-42bc-88d9-2d064238086b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cca6444-055a-42bc-88d9-2d064238086b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739cdd31-b064-4fe3-ae2f-195e16547c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739cdd31-b064-4fe3-ae2f-195e16547c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'defafa74-6762-4332-aebe-28b6789824d3', 'volume_name': 'volume-defafa74-6762-4332-aebe-28b6789824d3', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5aaa463-c03c-46ac-a9a5-4fe5de2231ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5aaa463-c03c-46ac-a9a5-4fe5de2231ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8844151f-0cc3-4d49-a599-25af8f97d5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:49 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Volume defafa74-6762-4332-aebe-28b6789824d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-defafa74-6762-4332-aebe-28b6789824d3', 'volume_size': 1}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-255621548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=defafa74-6762-4332-aebe-28b6789824d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbba2e13fc37450fa5f33e963fe2010d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:50Z,use_quota=True,user_id='fcda2a67783a40f8b1f6c6d59f7238ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Creating volume defafa74-6762-4332-aebe-28b6789824d3 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:20:49 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:20:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:50 devstack sudo[102555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3 1073741824
Sep 28 18:20:50 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:50 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3 1073741824" returned: 0 in 0.541s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:50 devstack sudo[102562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3
Sep 28 18:20:50 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3cca19f8-c7a0-48ad-8c0f-e04e07015308 tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:50 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3" returned: 0 in 0.394s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:20:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3cca19f8-c7a0-48ad-8c0f-e04e07015308 tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.218s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8844151f-0cc3-4d49-a599-25af8f97d5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-defafa74-6762-4332-aebe-28b6789824d3', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9430af9-dc28-4238-95dc-6d3e1896e85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:20:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-3cca19f8-c7a0-48ad-8c0f-e04e07015308 tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Creating offline snapshot e27ada84-12e8-4fde-a782-4568ac841168 of volume 1977031a-f15a-4a4a-8de5-9e07fb241f91 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:20:51 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Volume volume-defafa74-6762-4332-aebe-28b6789824d3 (defafa74-6762-4332-aebe-28b6789824d3): created successfully
Sep 28 18:20:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9430af9-dc28-4238-95dc-6d3e1896e85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:20:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Flow 'volume_create_manager' (d03bb615-d076-4b84-94f8-e2621b003b5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:20:51 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b78131c-4ac6-4efe-a968-b17c0be25aa5]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3cca19f8-c7a0-48ad-8c0f-e04e07015308 tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:51 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-f5198f1b-99d9-46ca-830f-dc0c785d2f24 tempest-VolumesSnapshotListTestJSON-157613269 None] Created volume successfully.
Sep 28 18:20:51 devstack sudo[102565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91
Sep 28 18:20:51 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:51 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3cca19f8-c7a0-48ad-8c0f-e04e07015308 tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91" returned: 0 in 0.400s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3cca19f8-c7a0-48ad-8c0f-e04e07015308 tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.e27ada84-12e8-4fde-a782-4568ac841168 2G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:51 devstack sudo[102570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.e27ada84-12e8-4fde-a782-4568ac841168 2G
Sep 28 18:20:51 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:51 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3cca19f8-c7a0-48ad-8c0f-e04e07015308 tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.e27ada84-12e8-4fde-a782-4568ac841168 2G" returned: 0 in 0.524s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3cca19f8-c7a0-48ad-8c0f-e04e07015308 tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1977031a-f15a-4a4a-8de5-9e07fb241f91 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.e27ada84-12e8-4fde-a782-4568ac841168 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:52 devstack sudo[102575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1977031a-f15a-4a4a-8de5-9e07fb241f91 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.e27ada84-12e8-4fde-a782-4568ac841168
Sep 28 18:20:52 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:52 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3cca19f8-c7a0-48ad-8c0f-e04e07015308 tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1977031a-f15a-4a4a-8de5-9e07fb241f91 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.e27ada84-12e8-4fde-a782-4568ac841168" returned: 0 in 0.351s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:52 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-3cca19f8-c7a0-48ad-8c0f-e04e07015308 tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.e27ada84-12e8-4fde-a782-4568ac841168 is being set with open permissions: ugo+rw
Sep 28 18:20:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3cca19f8-c7a0-48ad-8c0f-e04e07015308 tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.e27ada84-12e8-4fde-a782-4568ac841168 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:52 devstack sudo[102580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.e27ada84-12e8-4fde-a782-4568ac841168
Sep 28 18:20:52 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-cc6a11bd-a045-405d-8578-27726f1f8801 tempest-VolumesSnapshotListTestJSON-157613269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:52 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3cca19f8-c7a0-48ad-8c0f-e04e07015308 tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.e27ada84-12e8-4fde-a782-4568ac841168" returned: 0 in 0.255s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3cca19f8-c7a0-48ad-8c0f-e04e07015308 tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:52 devstack sudo[102583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.info
Sep 28 18:20:52 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:52 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3cca19f8-c7a0-48ad-8c0f-e04e07015308 tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.info" returned: 0 in 0.355s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:52 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-3cca19f8-c7a0-48ad-8c0f-e04e07015308 tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.info is being set with open permissions: ugo+rw
Sep 28 18:20:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3cca19f8-c7a0-48ad-8c0f-e04e07015308 tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:53 devstack sudo[102587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.info
Sep 28 18:20:53 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:53 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3cca19f8-c7a0-48ad-8c0f-e04e07015308 tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.info" returned: 0 in 0.311s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3cca19f8-c7a0-48ad-8c0f-e04e07015308 tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.334s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-cc6a11bd-a045-405d-8578-27726f1f8801 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.935s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-cc6a11bd-a045-405d-8578-27726f1f8801 tempest-VolumesSnapshotListTestJSON-157613269 None] Creating offline snapshot 406e3c81-8329-4782-a700-ac4d7ef0a7f7 of volume defafa74-6762-4332-aebe-28b6789824d3 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:20:53 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-3cca19f8-c7a0-48ad-8c0f-e04e07015308 tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Create snapshot completed successfully
Sep 28 18:20:53 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[60950054-56ed-4d36-9aaf-566fea5a5e48]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-cc6a11bd-a045-405d-8578-27726f1f8801 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:53 devstack sudo[102590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3
Sep 28 18:20:53 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:53 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-cc6a11bd-a045-405d-8578-27726f1f8801 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3" returned: 0 in 0.485s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-cc6a11bd-a045-405d-8578-27726f1f8801 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:53 devstack sudo[102595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7 1G
Sep 28 18:20:53 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:54 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2964dc6b-df63-4094-9086-1827048621ca tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Acquiring lock "cinder-e27ada84-12e8-4fde-a782-4568ac841168-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:54 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2964dc6b-df63-4094-9086-1827048621ca tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Lock "cinder-e27ada84-12e8-4fde-a782-4568ac841168-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:54 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2964dc6b-df63-4094-9086-1827048621ca tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Acquiring lock "cinder-quobyte-1977031a-f15a-4a4a-8de5-9e07fb241f91" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:54 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2964dc6b-df63-4094-9086-1827048621ca tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Lock "cinder-quobyte-1977031a-f15a-4a4a-8de5-9e07fb241f91" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:54 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2964dc6b-df63-4094-9086-1827048621ca tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Acquiring lock "cinder-quobyte-e27ada84-12e8-4fde-a782-4568ac841168" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:54 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2964dc6b-df63-4094-9086-1827048621ca tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Lock "cinder-quobyte-e27ada84-12e8-4fde-a782-4568ac841168" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:54 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-2964dc6b-df63-4094-9086-1827048621ca tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Deleting offline snapshot e27ada84-12e8-4fde-a782-4568ac841168 of volume 1977031a-f15a-4a4a-8de5-9e07fb241f91 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:20:54 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-2964dc6b-df63-4094-9086-1827048621ca tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] snapshot_file for this snap is: volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.e27ada84-12e8-4fde-a782-4568ac841168 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:20:54 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9111326-aa87-457e-abd4-ae8861d31e9b]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2964dc6b-df63-4094-9086-1827048621ca tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.e27ada84-12e8-4fde-a782-4568ac841168 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:54 devstack sudo[102598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.e27ada84-12e8-4fde-a782-4568ac841168
Sep 28 18:20:54 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:54 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-cc6a11bd-a045-405d-8578-27726f1f8801 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7 1G" returned: 0 in 0.682s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-cc6a11bd-a045-405d-8578-27726f1f8801 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-defafa74-6762-4332-aebe-28b6789824d3 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:54 devstack sudo[102604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-defafa74-6762-4332-aebe-28b6789824d3 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7
Sep 28 18:20:54 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:54 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2964dc6b-df63-4094-9086-1827048621ca tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.e27ada84-12e8-4fde-a782-4568ac841168" returned: 0 in 0.521s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:54 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-2964dc6b-df63-4094-9086-1827048621ca tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1977031a-f15a-4a4a-8de5-9e07fb241f91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:20:54 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8517cd15-bd3e-4958-a1c6-0bada36499e4]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2964dc6b-df63-4094-9086-1827048621ca tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:54 devstack sudo[102609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91
Sep 28 18:20:54 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:54 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-cc6a11bd-a045-405d-8578-27726f1f8801 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-defafa74-6762-4332-aebe-28b6789824d3 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7" returned: 0 in 0.381s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:54 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-cc6a11bd-a045-405d-8578-27726f1f8801 tempest-VolumesSnapshotListTestJSON-157613269 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7 is being set with open permissions: ugo+rw
Sep 28 18:20:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-cc6a11bd-a045-405d-8578-27726f1f8801 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:54 devstack sudo[102615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7
Sep 28 18:20:54 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:55 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-cc6a11bd-a045-405d-8578-27726f1f8801 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7" returned: 0 in 0.342s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-cc6a11bd-a045-405d-8578-27726f1f8801 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:55 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2964dc6b-df63-4094-9086-1827048621ca tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91" returned: 0 in 0.597s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2964dc6b-df63-4094-9086-1827048621ca tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.e27ada84-12e8-4fde-a782-4568ac841168 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:55 devstack sudo[102621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.info
Sep 28 18:20:55 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:55 devstack sudo[102622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.e27ada84-12e8-4fde-a782-4568ac841168
Sep 28 18:20:55 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:55 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-cc6a11bd-a045-405d-8578-27726f1f8801 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.info" returned: 0 in 0.318s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:55 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-cc6a11bd-a045-405d-8578-27726f1f8801 tempest-VolumesSnapshotListTestJSON-157613269 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.info is being set with open permissions: ugo+rw
Sep 28 18:20:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-cc6a11bd-a045-405d-8578-27726f1f8801 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:55 devstack sudo[102626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.info
Sep 28 18:20:55 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:55 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2964dc6b-df63-4094-9086-1827048621ca tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.e27ada84-12e8-4fde-a782-4568ac841168" returned: 0 in 0.596s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2964dc6b-df63-4094-9086-1827048621ca tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.e27ada84-12e8-4fde-a782-4568ac841168 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:55 devstack sudo[102632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.e27ada84-12e8-4fde-a782-4568ac841168
Sep 28 18:20:55 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:56 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-cc6a11bd-a045-405d-8578-27726f1f8801 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.info" returned: 0 in 0.354s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-cc6a11bd-a045-405d-8578-27726f1f8801 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.731s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:56 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-cc6a11bd-a045-405d-8578-27726f1f8801 tempest-VolumesSnapshotListTestJSON-157613269 None] Create snapshot completed successfully
Sep 28 18:20:56 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2964dc6b-df63-4094-9086-1827048621ca tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91.e27ada84-12e8-4fde-a782-4568ac841168" returned: 0 in 0.397s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2964dc6b-df63-4094-9086-1827048621ca tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Lock "cinder-quobyte-e27ada84-12e8-4fde-a782-4568ac841168" released by "_delete_snapshot" :: held 2.317s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2964dc6b-df63-4094-9086-1827048621ca tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Lock "cinder-quobyte-1977031a-f15a-4a4a-8de5-9e07fb241f91" released by "delete_snapshot" :: held 2.348s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:56 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-2964dc6b-df63-4094-9086-1827048621ca tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Created reservations ['8582c870-458d-4440-92b0-f15e90e1b956', 'acd13de9-eb70-405a-bc3e-8775d2062e4c', '3ab988fd-429c-49e1-8b62-8837842e5359', 'd35348a7-6b5d-425a-a711-adc3f5d21818'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:20:56 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-2964dc6b-df63-4094-9086-1827048621ca tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Delete snapshot completed successfully.
Sep 28 18:20:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2964dc6b-df63-4094-9086-1827048621ca tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Lock "cinder-e27ada84-12e8-4fde-a782-4568ac841168-delete_snapshot" released by "delete_snapshot" :: held 2.554s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-06bad267-7c58-4e1a-87de-75f33f2424fd tempest-VolumesSnapshotListTestJSON-157613269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-06bad267-7c58-4e1a-87de-75f33f2424fd tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-06bad267-7c58-4e1a-87de-75f33f2424fd tempest-VolumesSnapshotListTestJSON-157613269 None] Creating offline snapshot 3474931a-c07c-4334-aaec-e08e77a55b14 of volume defafa74-6762-4332-aebe-28b6789824d3 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:20:56 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4488a6c2-c951-4a20-87e7-0f22852fe1d8]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-06bad267-7c58-4e1a-87de-75f33f2424fd tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:56 devstack sudo[102636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7
Sep 28 18:20:56 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:57 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-06bad267-7c58-4e1a-87de-75f33f2424fd tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7" returned: 0 in 0.507s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:57 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-06bad267-7c58-4e1a-87de-75f33f2424fd tempest-VolumesSnapshotListTestJSON-157613269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-defafa74-6762-4332-aebe-28b6789824d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:20:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-06bad267-7c58-4e1a-87de-75f33f2424fd tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:57 devstack sudo[102643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14 1G
Sep 28 18:20:57 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9c7d87be-3de7-4528-b69b-6d7bb23cc5ea tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Acquiring lock "cinder-1977031a-f15a-4a4a-8de5-9e07fb241f91-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9c7d87be-3de7-4528-b69b-6d7bb23cc5ea tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Lock "cinder-1977031a-f15a-4a4a-8de5-9e07fb241f91-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9c7d87be-3de7-4528-b69b-6d7bb23cc5ea tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Acquiring lock "cinder-quobyte-1977031a-f15a-4a4a-8de5-9e07fb241f91" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:20:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9c7d87be-3de7-4528-b69b-6d7bb23cc5ea tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Lock "cinder-quobyte-1977031a-f15a-4a4a-8de5-9e07fb241f91" acquired by "delete_volume" :: waited 0.040s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:20:57 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d183e0-cf85-45fb-91c3-c0958cc5a19c]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:20:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9c7d87be-3de7-4528-b69b-6d7bb23cc5ea tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:57 devstack sudo[102647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91
Sep 28 18:20:57 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:58 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-06bad267-7c58-4e1a-87de-75f33f2424fd tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14 1G" returned: 0 in 0.810s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-06bad267-7c58-4e1a-87de-75f33f2424fd tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:58 devstack sudo[102653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14
Sep 28 18:20:58 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:58 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9c7d87be-3de7-4528-b69b-6d7bb23cc5ea tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91" returned: 0 in 0.588s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9c7d87be-3de7-4528-b69b-6d7bb23cc5ea tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:58 devstack sudo[102656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91
Sep 28 18:20:58 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:58 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-06bad267-7c58-4e1a-87de-75f33f2424fd tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14" returned: 0 in 0.367s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:58 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-06bad267-7c58-4e1a-87de-75f33f2424fd tempest-VolumesSnapshotListTestJSON-157613269 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14 is being set with open permissions: ugo+rw
Sep 28 18:20:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-06bad267-7c58-4e1a-87de-75f33f2424fd tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:58 devstack sudo[102662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14
Sep 28 18:20:58 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:58 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9c7d87be-3de7-4528-b69b-6d7bb23cc5ea tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1977031a-f15a-4a4a-8de5-9e07fb241f91" returned: 0 in 0.292s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9c7d87be-3de7-4528-b69b-6d7bb23cc5ea tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Lock "cinder-quobyte-1977031a-f15a-4a4a-8de5-9e07fb241f91" released by "delete_volume" :: held 0.963s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:20:58 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-9c7d87be-3de7-4528-b69b-6d7bb23cc5ea tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Created reservations ['b363d18d-26cd-4ef7-948d-42c36155951b', '29d23938-9f15-454f-9522-335b4e490f88', 'aad08d44-f4cc-4554-a6c3-d946e3712429', 'f40c3d02-1a9d-4e0b-8b9c-d28c0d890d8c'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:20:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9c7d87be-3de7-4528-b69b-6d7bb23cc5ea tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:20:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9c7d87be-3de7-4528-b69b-6d7bb23cc5ea tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:20:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9c7d87be-3de7-4528-b69b-6d7bb23cc5ea tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:20:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9c7d87be-3de7-4528-b69b-6d7bb23cc5ea tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:20:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9c7d87be-3de7-4528-b69b-6d7bb23cc5ea tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9c7d87be-3de7-4528-b69b-6d7bb23cc5ea tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:20:58 devstack sudo[102664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:20:58 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:20:58 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-06bad267-7c58-4e1a-87de-75f33f2424fd tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14" returned: 0 in 0.366s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-06bad267-7c58-4e1a-87de-75f33f2424fd tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.213s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:20:59 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-06bad267-7c58-4e1a-87de-75f33f2424fd tempest-VolumesSnapshotListTestJSON-157613269 None] Create snapshot completed successfully
Sep 28 18:20:59 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root
Sep 28 18:20:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9c7d87be-3de7-4528-b69b-6d7bb23cc5ea tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.336s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:20:59 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-9c7d87be-3de7-4528-b69b-6d7bb23cc5ea tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:20:59 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-9c7d87be-3de7-4528-b69b-6d7bb23cc5ea tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Deleted volume successfully.
Sep 28 18:20:59 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9c7d87be-3de7-4528-b69b-6d7bb23cc5ea tempest-VolumesSnapshotNegativeTestJSON-1085096995 None] Lock "cinder-1977031a-f15a-4a4a-8de5-9e07fb241f91-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b3f5d385-3637-4acc-8109-4c53d893fc74 tempest-VolumesSnapshotListTestJSON-157613269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b3f5d385-3637-4acc-8109-4c53d893fc74 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-b3f5d385-3637-4acc-8109-4c53d893fc74 tempest-VolumesSnapshotListTestJSON-157613269 None] Creating offline snapshot 903c0926-45c2-40ec-9c06-0cd1a226541c of volume defafa74-6762-4332-aebe-28b6789824d3 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:21:00 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2329f11-fe88-461f-9235-cbe4be3ddfd7]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b3f5d385-3637-4acc-8109-4c53d893fc74 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:00 devstack sudo[102669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14
Sep 28 18:21:00 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:00 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b3f5d385-3637-4acc-8109-4c53d893fc74 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14" returned: 0 in 0.510s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-b3f5d385-3637-4acc-8109-4c53d893fc74 tempest-VolumesSnapshotListTestJSON-157613269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-defafa74-6762-4332-aebe-28b6789824d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:21:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b3f5d385-3637-4acc-8109-4c53d893fc74 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.903c0926-45c2-40ec-9c06-0cd1a226541c 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:00 devstack sudo[102675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.903c0926-45c2-40ec-9c06-0cd1a226541c 1G
Sep 28 18:21:00 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:01 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b3f5d385-3637-4acc-8109-4c53d893fc74 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.903c0926-45c2-40ec-9c06-0cd1a226541c 1G" returned: 0 in 0.765s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b3f5d385-3637-4acc-8109-4c53d893fc74 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.903c0926-45c2-40ec-9c06-0cd1a226541c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:01 devstack sudo[102687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.903c0926-45c2-40ec-9c06-0cd1a226541c
Sep 28 18:21:01 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:02 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b3f5d385-3637-4acc-8109-4c53d893fc74 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.903c0926-45c2-40ec-9c06-0cd1a226541c" returned: 0 in 0.471s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:02 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-b3f5d385-3637-4acc-8109-4c53d893fc74 tempest-VolumesSnapshotListTestJSON-157613269 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.903c0926-45c2-40ec-9c06-0cd1a226541c is being set with open permissions: ugo+rw
Sep 28 18:21:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b3f5d385-3637-4acc-8109-4c53d893fc74 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.903c0926-45c2-40ec-9c06-0cd1a226541c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:02 devstack sudo[102692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.903c0926-45c2-40ec-9c06-0cd1a226541c
Sep 28 18:21:02 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:02 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b3f5d385-3637-4acc-8109-4c53d893fc74 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.903c0926-45c2-40ec-9c06-0cd1a226541c" returned: 0 in 0.371s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b3f5d385-3637-4acc-8109-4c53d893fc74 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.317s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:02 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-b3f5d385-3637-4acc-8109-4c53d893fc74 tempest-VolumesSnapshotListTestJSON-157613269 None] Create snapshot completed successfully
Sep 28 18:21:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] Acquiring lock "cinder-903c0926-45c2-40ec-9c06-0cd1a226541c-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "cinder-903c0926-45c2-40ec-9c06-0cd1a226541c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] Acquiring lock "cinder-quobyte-defafa74-6762-4332-aebe-28b6789824d3" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "cinder-quobyte-defafa74-6762-4332-aebe-28b6789824d3" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] Acquiring lock "cinder-quobyte-903c0926-45c2-40ec-9c06-0cd1a226541c" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "cinder-quobyte-903c0926-45c2-40ec-9c06-0cd1a226541c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:04 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] Deleting offline snapshot 903c0926-45c2-40ec-9c06-0cd1a226541c of volume defafa74-6762-4332-aebe-28b6789824d3 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:21:04 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] snapshot_file for this snap is: volume-defafa74-6762-4332-aebe-28b6789824d3.903c0926-45c2-40ec-9c06-0cd1a226541c {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:21:04 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a94189-30c1-44bd-be63-68e0410ae9b5]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.903c0926-45c2-40ec-9c06-0cd1a226541c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:04 devstack sudo[102696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.903c0926-45c2-40ec-9c06-0cd1a226541c
Sep 28 18:21:04 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Flow 'volume_create_manager' (489c3b1d-166b-4ce4-b38e-3f231456bece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fdc986f-23c9-4ea3-ab19-fcef16ba60b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fdc986f-23c9-4ea3-ab19-fcef16ba60b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-387107963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d10fa7-c949-4bfc-b6ce-5cb929676488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f543a3c68664b4cb0793e1557b9a6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:05Z,use_quota=True,user_id='2233b45ea4aa4d26b8bc27a3fb959fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6e6ff8-a105-41b6-a8a0-8be442d856c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6e6ff8-a105-41b6-a8a0-8be442d856c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9faae6af-2c30-4eea-a435-3e67af39de03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9faae6af-2c30-4eea-a435-3e67af39de03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d10fa7-c949-4bfc-b6ce-5cb929676488', 'volume_name': 'volume-05d10fa7-c949-4bfc-b6ce-5cb929676488', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e8f1ed-e4a4-42d0-a477-c9852fe9352a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e8f1ed-e4a4-42d0-a477-c9852fe9352a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8745ff77-d2b5-41b2-bc13-5ce0a9f6ad81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:05 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Volume 05d10fa7-c949-4bfc-b6ce-5cb929676488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d10fa7-c949-4bfc-b6ce-5cb929676488', 'volume_size': 1}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-387107963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d10fa7-c949-4bfc-b6ce-5cb929676488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f543a3c68664b4cb0793e1557b9a6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:05Z,use_quota=True,user_id='2233b45ea4aa4d26b8bc27a3fb959fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Creating volume 05d10fa7-c949-4bfc-b6ce-5cb929676488 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:05 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:21:05 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.903c0926-45c2-40ec-9c06-0cd1a226541c" returned: 0 in 0.565s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-defafa74-6762-4332-aebe-28b6789824d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:21:05 devstack sudo[102701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488 1073741824
Sep 28 18:21:05 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c745114e-4f5a-4fc7-b688-3d8f71ccff9f]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:05 devstack sudo[102703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14
Sep 28 18:21:05 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:05 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14" returned: 0 in 0.451s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-defafa74-6762-4332-aebe-28b6789824d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.903c0926-45c2-40ec-9c06-0cd1a226541c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:05 devstack sudo[102713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.903c0926-45c2-40ec-9c06-0cd1a226541c
Sep 28 18:21:05 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:05 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488 1073741824" returned: 0 in 0.576s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:05 devstack sudo[102715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488
Sep 28 18:21:05 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:06 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488" returned: 0 in 0.289s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:06 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:21:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8745ff77-d2b5-41b2-bc13-5ce0a9f6ad81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d10fa7-c949-4bfc-b6ce-5cb929676488', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7e23ae-9ef5-439b-8aa3-7fb504377f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:06 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Volume volume-05d10fa7-c949-4bfc-b6ce-5cb929676488 (05d10fa7-c949-4bfc-b6ce-5cb929676488): created successfully
Sep 28 18:21:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7e23ae-9ef5-439b-8aa3-7fb504377f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Flow 'volume_create_manager' (489c3b1d-166b-4ce4-b38e-3f231456bece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:06 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-7f7c38af-db36-4ae9-9fdd-a5807a83a625 tempest-CreateVolumesFromSnapshotTest-522091956 None] Created volume successfully.
Sep 28 18:21:06 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.903c0926-45c2-40ec-9c06-0cd1a226541c" returned: 0 in 0.627s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.903c0926-45c2-40ec-9c06-0cd1a226541c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:06 devstack sudo[102722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.903c0926-45c2-40ec-9c06-0cd1a226541c
Sep 28 18:21:06 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:06 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.903c0926-45c2-40ec-9c06-0cd1a226541c" returned: 0 in 0.303s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:06 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "cinder-quobyte-903c0926-45c2-40ec-9c06-0cd1a226541c" released by "_delete_snapshot" :: held 2.112s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:06 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "cinder-quobyte-defafa74-6762-4332-aebe-28b6789824d3" released by "delete_snapshot" :: held 2.138s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:06 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] Created reservations ['ace4256b-9c27-48af-9140-ed4e5bde02f1', 'e4eced9b-8b8e-41e6-a46a-e6729c45378d', 'efceee15-cd36-4d47-b032-ea21f6b38fa8', 'c2db6139-13f3-462c-b882-8b8bb96d0365'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:21:06 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] Delete snapshot completed successfully.
Sep 28 18:21:06 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-faf544ab-83ec-4879-8a6d-eb2f66246cf1 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "cinder-903c0926-45c2-40ec-9c06-0cd1a226541c-delete_snapshot" released by "delete_snapshot" :: held 2.324s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-21cc218d-5e9d-4123-80db-b02d200195cd tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-21cc218d-5e9d-4123-80db-b02d200195cd tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:07 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-21cc218d-5e9d-4123-80db-b02d200195cd tempest-CreateVolumesFromSnapshotTest-522091956 None] Creating offline snapshot 49382975-5c60-4d4f-8503-747eb2a60014 of volume 05d10fa7-c949-4bfc-b6ce-5cb929676488 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:21:07 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf5d713-6825-4169-8fa7-5a5b6a770243]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-21cc218d-5e9d-4123-80db-b02d200195cd tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] Acquiring lock "cinder-3474931a-c07c-4334-aaec-e08e77a55b14-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "cinder-3474931a-c07c-4334-aaec-e08e77a55b14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] Acquiring lock "cinder-quobyte-defafa74-6762-4332-aebe-28b6789824d3" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "cinder-quobyte-defafa74-6762-4332-aebe-28b6789824d3" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] Acquiring lock "cinder-quobyte-3474931a-c07c-4334-aaec-e08e77a55b14" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:07 devstack sudo[102725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488
Sep 28 18:21:07 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "cinder-quobyte-3474931a-c07c-4334-aaec-e08e77a55b14" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] Deleting offline snapshot 3474931a-c07c-4334-aaec-e08e77a55b14 of volume defafa74-6762-4332-aebe-28b6789824d3 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:21:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] snapshot_file for this snap is: volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:21:08 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40038c5-120c-40c1-a37e-91fa9310a56b]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:08 devstack sudo[102727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14
Sep 28 18:21:08 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:08 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-21cc218d-5e9d-4123-80db-b02d200195cd tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488" returned: 0 in 0.556s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-21cc218d-5e9d-4123-80db-b02d200195cd tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.49382975-5c60-4d4f-8503-747eb2a60014 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:08 devstack sudo[102732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.49382975-5c60-4d4f-8503-747eb2a60014 1G
Sep 28 18:21:08 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:08 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14" returned: 0 in 0.490s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-defafa74-6762-4332-aebe-28b6789824d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:21:08 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59f8634-0463-4ea6-b2da-b855951e42ac]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:08 devstack sudo[102737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7
Sep 28 18:21:08 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:09 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-21cc218d-5e9d-4123-80db-b02d200195cd tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.49382975-5c60-4d4f-8503-747eb2a60014 1G" returned: 0 in 0.642s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-21cc218d-5e9d-4123-80db-b02d200195cd tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d10fa7-c949-4bfc-b6ce-5cb929676488 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.49382975-5c60-4d4f-8503-747eb2a60014 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:09 devstack sudo[102742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d10fa7-c949-4bfc-b6ce-5cb929676488 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.49382975-5c60-4d4f-8503-747eb2a60014
Sep 28 18:21:09 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:09 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7" returned: 0 in 0.552s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-defafa74-6762-4332-aebe-28b6789824d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:21:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:09 devstack sudo[102747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14
Sep 28 18:21:09 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:09 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-21cc218d-5e9d-4123-80db-b02d200195cd tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d10fa7-c949-4bfc-b6ce-5cb929676488 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.49382975-5c60-4d4f-8503-747eb2a60014" returned: 0 in 0.389s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:09 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-21cc218d-5e9d-4123-80db-b02d200195cd tempest-CreateVolumesFromSnapshotTest-522091956 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.49382975-5c60-4d4f-8503-747eb2a60014 is being set with open permissions: ugo+rw
Sep 28 18:21:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-21cc218d-5e9d-4123-80db-b02d200195cd tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.49382975-5c60-4d4f-8503-747eb2a60014 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:09 devstack sudo[102753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.49382975-5c60-4d4f-8503-747eb2a60014
Sep 28 18:21:09 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:09 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14" returned: 0 in 0.561s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:09 devstack sudo[102759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14
Sep 28 18:21:09 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:09 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-21cc218d-5e9d-4123-80db-b02d200195cd tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.49382975-5c60-4d4f-8503-747eb2a60014" returned: 0 in 0.417s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-21cc218d-5e9d-4123-80db-b02d200195cd tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:09 devstack sudo[102762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.info
Sep 28 18:21:09 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:09 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:21:09 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Flow 'volume_create_manager' (645909ab-7bbf-4e13-9db1-e0c657d56a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:09 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c80486-7aaa-4913-b03f-d8cb14e588b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:09 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c80486-7aaa-4913-b03f-d8cb14e588b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320a1946-ad00-4f54-8c21-42acfacfc981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='255167336cca4e538d8d1bdea8a760e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:10Z,use_quota=True,user_id='5e187d09d0ed442a9f20200e06ac4d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90e60d1a-4c67-4f10-bab3-ab914d285878),volume_type_id=90e60d1a-4c67-4f10-bab3-ab914d285878)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:09 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6811a3d2-42ce-4c7d-8a48-a2cef6e26257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:09 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6811a3d2-42ce-4c7d-8a48-a2cef6e26257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:09 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d79dc218-ec73-447f-a5b1-f97e3ab37249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:09 devstack cinder-volume[87046]: DEBUG cinder.image.glance [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Creating Keystone auth plugin from conf {{(pid=87046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 28 18:21:10 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.3474931a-c07c-4334-aaec-e08e77a55b14" returned: 0 in 0.358s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:10 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "cinder-quobyte-3474931a-c07c-4334-aaec-e08e77a55b14" released by "_delete_snapshot" :: held 2.136s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:10 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "cinder-quobyte-defafa74-6762-4332-aebe-28b6789824d3" released by "delete_snapshot" :: held 2.169s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:10 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-21cc218d-5e9d-4123-80db-b02d200195cd tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.info" returned: 0 in 0.335s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:10 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-21cc218d-5e9d-4123-80db-b02d200195cd tempest-CreateVolumesFromSnapshotTest-522091956 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.info is being set with open permissions: ugo+rw
Sep 28 18:21:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-21cc218d-5e9d-4123-80db-b02d200195cd tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:10 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] Created reservations ['3742a111-7e38-488a-9e68-e8400b93b95c', 'e60c4aa7-c29b-4016-acaa-21c89725cbb7', '77ef7024-3f97-4674-aab7-6d87c123ec5c', '96456395-3e30-4c41-affa-a7ef95fc4e26'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:21:10 devstack sudo[102766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.info
Sep 28 18:21:10 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:10 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d79dc218-ec73-447f-a5b1-f97e3ab37249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '320a1946-ad00-4f54-8c21-42acfacfc981', 'volume_name': 'volume-320a1946-ad00-4f54-8c21-42acfacfc981', 'volume_size': 1, 'image_id': '539ab3ea-534d-41c6-b08f-35843a922aae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/539ab3ea-534d-41c6-b08f-35843a922aae', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '24e4e2d01ad38e476a5fbb8e88bd3d14', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '255167336cca4e538d8d1bdea8a760e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0e063f419f986aa36b1ac5f392bbabdefc5a29002c469043eb32c472bb0aed0ce476bff596807c7e8f3dd52855e866f6562f77d87f7d0711a8deec2817def5f9', 'id': '539ab3ea-534d-41c6-b08f-35843a922aae', 'created_at': datetime.datetime(2026, 9, 28, 16, 21, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 21, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539ab3ea-534d-41c6-b08f-35843a922aae/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aa4aed1c0>}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:10 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b60dfa5-74ad-46b4-b478-229d6f9e23e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:10 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b60dfa5-74ad-46b4-b478-229d6f9e23e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:10 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0af1d5-9676-442e-9dc6-81dddc0d758d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:10 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Volume 320a1946-ad00-4f54-8c21-42acfacfc981: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-320a1946-ad00-4f54-8c21-42acfacfc981', 'volume_size': 1, 'image_id': '539ab3ea-534d-41c6-b08f-35843a922aae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/539ab3ea-534d-41c6-b08f-35843a922aae', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '24e4e2d01ad38e476a5fbb8e88bd3d14', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '255167336cca4e538d8d1bdea8a760e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0e063f419f986aa36b1ac5f392bbabdefc5a29002c469043eb32c472bb0aed0ce476bff596807c7e8f3dd52855e866f6562f77d87f7d0711a8deec2817def5f9', 'id': '539ab3ea-534d-41c6-b08f-35843a922aae', 'created_at': datetime.datetime(2026, 9, 28, 16, 21, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 21, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539ab3ea-534d-41c6-b08f-35843a922aae/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aa4aed1c0>}
Sep 28 18:21:10 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Trying to clone 320a1946-ad00-4f54-8c21-42acfacfc981 from image 539ab3ea-534d-41c6-b08f-35843a922aae at location (None, [{'url': 'file:///opt/stack/data/glance/images/539ab3ea-534d-41c6-b08f-35843a922aae', 'metadata': {}}]). {{(pid=87046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 28 18:21:10 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] Delete snapshot completed successfully.
Sep 28 18:21:10 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d37d1a96-76d3-46a6-b4aa-b8995213e852 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "cinder-3474931a-c07c-4334-aaec-e08e77a55b14-delete_snapshot" released by "delete_snapshot" :: held 2.418s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:10 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 28 18:21:10 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Image download 0.00 MB at 0.00 MB/s
Sep 28 18:21:10 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bb75a6-b666-4673-93d1-314cc67bf41f]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:10 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-21cc218d-5e9d-4123-80db-b02d200195cd tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.info" returned: 0 in 0.318s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-21cc218d-5e9d-4123-80db-b02d200195cd tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.803s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:10 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-21cc218d-5e9d-4123-80db-b02d200195cd tempest-CreateVolumesFromSnapshotTest-522091956 None] Create snapshot completed successfully
Sep 28 18:21:10 devstack sudo[102769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD
Sep 28 18:21:10 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:10 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:11 devstack sudo[102774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD
Sep 28 18:21:11 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-61d59562-1bc5-43ee-9ae9-ee2f905294ff tempest-VolumesSnapshotListTestJSON-157613269 None] Acquiring lock "cinder-406e3c81-8329-4782-a700-ac4d7ef0a7f7-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-61d59562-1bc5-43ee-9ae9-ee2f905294ff tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "cinder-406e3c81-8329-4782-a700-ac4d7ef0a7f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-61d59562-1bc5-43ee-9ae9-ee2f905294ff tempest-VolumesSnapshotListTestJSON-157613269 None] Acquiring lock "cinder-quobyte-defafa74-6762-4332-aebe-28b6789824d3" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-61d59562-1bc5-43ee-9ae9-ee2f905294ff tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "cinder-quobyte-defafa74-6762-4332-aebe-28b6789824d3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-61d59562-1bc5-43ee-9ae9-ee2f905294ff tempest-VolumesSnapshotListTestJSON-157613269 None] Acquiring lock "cinder-quobyte-406e3c81-8329-4782-a700-ac4d7ef0a7f7" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-61d59562-1bc5-43ee-9ae9-ee2f905294ff tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "cinder-quobyte-406e3c81-8329-4782-a700-ac4d7ef0a7f7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-61d59562-1bc5-43ee-9ae9-ee2f905294ff tempest-VolumesSnapshotListTestJSON-157613269 None] Deleting offline snapshot 406e3c81-8329-4782-a700-ac4d7ef0a7f7 of volume defafa74-6762-4332-aebe-28b6789824d3 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:21:11 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-61d59562-1bc5-43ee-9ae9-ee2f905294ff tempest-VolumesSnapshotListTestJSON-157613269 None] snapshot_file for this snap is: volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD" returned: 1 in 0.439s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Temporary image 539ab3ea-534d-41c6-b08f-35843a922aae is fetched for user 5e187d09d0ed442a9f20200e06ac4d8c. {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[86177fd4-dcdc-43a9-873a-5b1a0c974e43]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-61d59562-1bc5-43ee-9ae9-ee2f905294ff tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d3b923-0cfb-40fd-87cd-73b21744caa7]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:11 devstack sudo[102780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7
Sep 28 18:21:11 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:11 devstack sudo[102781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD
Sep 28 18:21:11 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Flow 'volume_create_manager' (53cf217c-4e42-4bd1-93ae-eac56e301a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8859d0f8-18e5-4189-bf04-f1c9226067e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8859d0f8-18e5-4189-bf04-f1c9226067e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-437123473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2b7409-7300-4f1d-b56a-3f66d41aa6f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f543a3c68664b4cb0793e1557b9a6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:12Z,use_quota=True,user_id='2233b45ea4aa4d26b8bc27a3fb959fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1decad8f-fd18-4278-827c-0b3c4ab9c4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1decad8f-fd18-4278-827c-0b3c4ab9c4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ecc887-03fc-4e43-88e1-dc032d0efc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ecc887-03fc-4e43-88e1-dc032d0efc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e2b7409-7300-4f1d-b56a-3f66d41aa6f8', 'volume_name': 'volume-0e2b7409-7300-4f1d-b56a-3f66d41aa6f8', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6452926b-bfdc-432e-831b-83bbbcb69cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6452926b-bfdc-432e-831b-83bbbcb69cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e874e660-ebcb-4181-9e0c-ecb50c7032b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:11 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Volume 0e2b7409-7300-4f1d-b56a-3f66d41aa6f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e2b7409-7300-4f1d-b56a-3f66d41aa6f8', 'volume_size': 1}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-437123473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2b7409-7300-4f1d-b56a-3f66d41aa6f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f543a3c68664b4cb0793e1557b9a6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:12Z,use_quota=True,user_id='2233b45ea4aa4d26b8bc27a3fb959fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Creating volume 0e2b7409-7300-4f1d-b56a-3f66d41aa6f8 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:21:11 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e2b7409-7300-4f1d-b56a-3f66d41aa6f8 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:11 devstack sudo[102786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e2b7409-7300-4f1d-b56a-3f66d41aa6f8 1073741824
Sep 28 18:21:11 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:11 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-61d59562-1bc5-43ee-9ae9-ee2f905294ff tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7" returned: 0 in 0.514s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-61d59562-1bc5-43ee-9ae9-ee2f905294ff tempest-VolumesSnapshotListTestJSON-157613269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-defafa74-6762-4332-aebe-28b6789824d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:21:11 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[427868c2-23ff-4705-b544-3c0ed644c33a]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-61d59562-1bc5-43ee-9ae9-ee2f905294ff tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD" returned: 0 in 0.533s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:12 devstack sudo[102791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3
Sep 28 18:21:12 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Flow 'volume_create_manager' (805816e5-0073-41b9-b433-97de92831116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d369e3-0d37-4195-a244-94a283634b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:12 devstack sudo[102792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD
Sep 28 18:21:12 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d369e3-0d37-4195-a244-94a283634b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-816012110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c824363-d71e-4a38-97b6-017cdd7d5d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f543a3c68664b4cb0793e1557b9a6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:12Z,use_quota=True,user_id='2233b45ea4aa4d26b8bc27a3fb959fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5190057b-6fad-43e4-aee2-cc44e07efc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5190057b-6fad-43e4-aee2-cc44e07efc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7dee96f-d8b1-442f-982b-27277dad4acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7dee96f-d8b1-442f-982b-27277dad4acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c824363-d71e-4a38-97b6-017cdd7d5d17', 'volume_name': 'volume-0c824363-d71e-4a38-97b6-017cdd7d5d17', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6fe6c2a-f422-4301-8af4-ca78c310cd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6fe6c2a-f422-4301-8af4-ca78c310cd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (838b303d-16fe-4a2f-ae81-fd639ca02a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:12 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Volume 0c824363-d71e-4a38-97b6-017cdd7d5d17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c824363-d71e-4a38-97b6-017cdd7d5d17', 'volume_size': 1}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:12 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD" returned: 1 in 0.574s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:12 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e2b7409-7300-4f1d-b56a-3f66d41aa6f8 1073741824" returned: 0 in 0.805s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:12 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-61d59562-1bc5-43ee-9ae9-ee2f905294ff tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3" returned: 0 in 0.660s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-61d59562-1bc5-43ee-9ae9-ee2f905294ff tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:12 devstack sudo[102806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7
Sep 28 18:21:12 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e2b7409-7300-4f1d-b56a-3f66d41aa6f8 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:12 devstack sudo[102808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e2b7409-7300-4f1d-b56a-3f66d41aa6f8
Sep 28 18:21:12 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Flow 'volume_create_manager' (2358b98d-bc11-4fc8-85b1-be65fa71cef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee1d4e9-eda2-4c80-8e70-4dabefdab8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee1d4e9-eda2-4c80-8e70-4dabefdab8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1865981785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f543a3c68664b4cb0793e1557b9a6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:13Z,use_quota=True,user_id='2233b45ea4aa4d26b8bc27a3fb959fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f10b95b-58b1-4855-9ed5-dce2939af08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f10b95b-58b1-4855-9ed5-dce2939af08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (267063f3-e901-4717-a50a-4d8db202bc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (267063f3-e901-4717-a50a-4d8db202bc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4', 'volume_name': 'volume-63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ebb934-2c81-4d31-a6aa-441c46789299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ebb934-2c81-4d31-a6aa-441c46789299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e8b846-efd9-42d8-ab77-250ae5958682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:12 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Volume 63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4', 'volume_size': 1}
Sep 28 18:21:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:13 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e2b7409-7300-4f1d-b56a-3f66d41aa6f8" returned: 0 in 0.444s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.858s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-816012110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c824363-d71e-4a38-97b6-017cdd7d5d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f543a3c68664b4cb0793e1557b9a6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:12Z,use_quota=True,user_id='2233b45ea4aa4d26b8bc27a3fb959fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Creating volume 0c824363-d71e-4a38-97b6-017cdd7d5d17 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:21:13 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0c824363-d71e-4a38-97b6-017cdd7d5d17 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:13 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-61d59562-1bc5-43ee-9ae9-ee2f905294ff tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7" returned: 0 in 0.536s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:13 devstack sudo[102816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0c824363-d71e-4a38-97b6-017cdd7d5d17 1073741824
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-61d59562-1bc5-43ee-9ae9-ee2f905294ff tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:13 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:13 devstack sudo[102818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7
Sep 28 18:21:13 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e874e660-ebcb-4181-9e0c-ecb50c7032b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e2b7409-7300-4f1d-b56a-3f66d41aa6f8', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f47fd4-e172-440a-bbf2-638650b78b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:13 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Volume volume-0e2b7409-7300-4f1d-b56a-3f66d41aa6f8 (0e2b7409-7300-4f1d-b56a-3f66d41aa6f8): created successfully
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f47fd4-e172-440a-bbf2-638650b78b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Flow 'volume_create_manager' (53cf217c-4e42-4bd1-93ae-eac56e301a73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Flow 'volume_create_manager' (e7a5d7a7-484c-43b1-93d8-c4c4adad3a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee63a90f-39a6-4ad8-ac07-fed842ae387a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee63a90f-39a6-4ad8-ac07-fed842ae387a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-469556611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c11d1b-d0e8-4ff8-a518-29d7867fe106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f543a3c68664b4cb0793e1557b9a6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:13Z,use_quota=True,user_id='2233b45ea4aa4d26b8bc27a3fb959fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dafc308-33b4-429f-bec4-9913891953ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dafc308-33b4-429f-bec4-9913891953ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe71276-2df6-4143-a227-6fae3ba6fb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe71276-2df6-4143-a227-6fae3ba6fb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7c11d1b-d0e8-4ff8-a518-29d7867fe106', 'volume_name': 'volume-e7c11d1b-d0e8-4ff8-a518-29d7867fe106', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (994c757f-2144-4593-a48b-704deb6b095c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (994c757f-2144-4593-a48b-704deb6b095c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f34293-2a76-4935-9081-617fc76141bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:13 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Volume e7c11d1b-d0e8-4ff8-a518-29d7867fe106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7c11d1b-d0e8-4ff8-a518-29d7867fe106', 'volume_size': 1}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:13 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-1cd77937-7636-4b7d-b262-66da8838a331 tempest-CreateVolumesFromSnapshotTest-522091956 None] Created volume successfully.
Sep 28 18:21:13 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-61d59562-1bc5-43ee-9ae9-ee2f905294ff tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3.406e3c81-8329-4782-a700-ac4d7ef0a7f7" returned: 0 in 0.343s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-61d59562-1bc5-43ee-9ae9-ee2f905294ff tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "cinder-quobyte-406e3c81-8329-4782-a700-ac4d7ef0a7f7" released by "_delete_snapshot" :: held 2.252s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-61d59562-1bc5-43ee-9ae9-ee2f905294ff tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "cinder-quobyte-defafa74-6762-4332-aebe-28b6789824d3" released by "delete_snapshot" :: held 2.283s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-61d59562-1bc5-43ee-9ae9-ee2f905294ff tempest-VolumesSnapshotListTestJSON-157613269 None] Created reservations ['909653db-f614-4a8d-af5f-4c92ff4bdd99', 'ab37ce2b-e08c-428b-a2d4-444276226dc1', 'cf84adfc-23b4-438f-9565-3b5f0103e27c', '1d4a0dbc-c0f0-42b8-97d7-a22ab86466f0'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:21:13 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-61d59562-1bc5-43ee-9ae9-ee2f905294ff tempest-VolumesSnapshotListTestJSON-157613269 None] Delete snapshot completed successfully.
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-61d59562-1bc5-43ee-9ae9-ee2f905294ff tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "cinder-406e3c81-8329-4782-a700-ac4d7ef0a7f7-delete_snapshot" released by "delete_snapshot" :: held 2.485s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:21:13 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Flow 'volume_create_manager' (160905f4-c7ea-495c-ba4f-db8632701253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (924b5050-775d-4909-b83c-9dc1fba3bff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0c824363-d71e-4a38-97b6-017cdd7d5d17 1073741824" returned: 0 in 0.658s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (924b5050-775d-4909-b83c-9dc1fba3bff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-128134207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=374038a6-b68a-42ce-b553-7f1647c9b199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f543a3c68664b4cb0793e1557b9a6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:14Z,use_quota=True,user_id='2233b45ea4aa4d26b8bc27a3fb959fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587bb12f-f8b0-481e-8f7c-23a7ac8261d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587bb12f-f8b0-481e-8f7c-23a7ac8261d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73aa1fb3-732f-4653-b94a-4449abd2bc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73aa1fb3-732f-4653-b94a-4449abd2bc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '374038a6-b68a-42ce-b553-7f1647c9b199', 'volume_name': 'volume-374038a6-b68a-42ce-b553-7f1647c9b199', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd661ff-3a4b-463f-85c4-a6dd6e18c23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd661ff-3a4b-463f-85c4-a6dd6e18c23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe57310c-f3e1-4ae4-876b-342a7f865dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:13 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Volume 374038a6-b68a-42ce-b553-7f1647c9b199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-374038a6-b68a-42ce-b553-7f1647c9b199', 'volume_size': 1}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0c824363-d71e-4a38-97b6-017cdd7d5d17 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:13 devstack sudo[102825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0c824363-d71e-4a38-97b6-017cdd7d5d17
Sep 28 18:21:13 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:14 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0c824363-d71e-4a38-97b6-017cdd7d5d17" returned: 0 in 0.285s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.612s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320a1946-ad00-4f54-8c21-42acfacfc981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='255167336cca4e538d8d1bdea8a760e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:10Z,use_quota=True,user_id='5e187d09d0ed442a9f20200e06ac4d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90e60d1a-4c67-4f10-bab3-ab914d285878),volume_type_id=90e60d1a-4c67-4f10-bab3-ab914d285878)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Creating volume 320a1946-ad00-4f54-8c21-42acfacfc981 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:21:14 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-320a1946-ad00-4f54-8c21-42acfacfc981 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (838b303d-16fe-4a2f-ae81-fd639ca02a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c824363-d71e-4a38-97b6-017cdd7d5d17', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:14 devstack sudo[102828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-320a1946-ad00-4f54-8c21-42acfacfc981 1073741824
Sep 28 18:21:14 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce4c14d7-d52d-4ceb-ad52-51bf794fc200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:14 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Volume volume-0c824363-d71e-4a38-97b6-017cdd7d5d17 (0c824363-d71e-4a38-97b6-017cdd7d5d17): created successfully
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce4c14d7-d52d-4ceb-ad52-51bf794fc200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Flow 'volume_create_manager' (805816e5-0073-41b9-b433-97de92831116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:14 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-9bb6995d-769c-432e-bac6-367b54631db4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Created volume successfully.
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ed0f4edd-6ec2-4605-a836-5668b8614559 tempest-VolumesSnapshotListTestJSON-157613269 None] Acquiring lock "cinder-defafa74-6762-4332-aebe-28b6789824d3-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ed0f4edd-6ec2-4605-a836-5668b8614559 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "cinder-defafa74-6762-4332-aebe-28b6789824d3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:UPDATE=128,cinder:SELECT=126,cinder:INSERT=34,cinder:DELETE=11 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=129,cinder:UPDATE=127,cinder:INSERT=40,cinder:DELETE=10 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ed0f4edd-6ec2-4605-a836-5668b8614559 tempest-VolumesSnapshotListTestJSON-157613269 None] Acquiring lock "cinder-quobyte-defafa74-6762-4332-aebe-28b6789824d3" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ed0f4edd-6ec2-4605-a836-5668b8614559 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "cinder-quobyte-defafa74-6762-4332-aebe-28b6789824d3" acquired by "delete_volume" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffb70b4-1904-46c8-8cd1-3240fca6563a]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ed0f4edd-6ec2-4605-a836-5668b8614559 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:14 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-320a1946-ad00-4f54-8c21-42acfacfc981 1073741824" returned: 0 in 0.608s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-320a1946-ad00-4f54-8c21-42acfacfc981 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:14 devstack sudo[102836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-320a1946-ad00-4f54-8c21-42acfacfc981
Sep 28 18:21:14 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:14 devstack sudo[102835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3
Sep 28 18:21:14 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:15 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-320a1946-ad00-4f54-8c21-42acfacfc981" returned: 0 in 0.343s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.340s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1865981785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f543a3c68664b4cb0793e1557b9a6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:13Z,use_quota=True,user_id='2233b45ea4aa4d26b8bc27a3fb959fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Creating volume 63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:21:15 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:15 devstack sudo[102843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4 1073741824
Sep 28 18:21:15 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:15 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ed0f4edd-6ec2-4605-a836-5668b8614559 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3" returned: 0 in 0.529s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ed0f4edd-6ec2-4605-a836-5668b8614559 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Attempting download of 539ab3ea-534d-41c6-b08f-35843a922aae ((None, [{'url': 'file:///opt/stack/data/glance/images/539ab3ea-534d-41c6-b08f-35843a922aae', 'metadata': {}}])) to volume 320a1946-ad00-4f54-8c21-42acfacfc981. {{(pid=87046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 28 18:21:15 devstack sudo[102845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3
Sep 28 18:21:15 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c590cab-0549-4f8e-badc-82d6288a9f1f]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_539ab3ea-534d-41c6-b08f-35843a922aae_sw6j3nf2 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:15 devstack sudo[102847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_539ab3ea-534d-41c6-b08f-35843a922aae_sw6j3nf2
Sep 28 18:21:15 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:15 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ed0f4edd-6ec2-4605-a836-5668b8614559 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-defafa74-6762-4332-aebe-28b6789824d3" returned: 0 in 0.294s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ed0f4edd-6ec2-4605-a836-5668b8614559 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "cinder-quobyte-defafa74-6762-4332-aebe-28b6789824d3" released by "delete_volume" :: held 0.910s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-ed0f4edd-6ec2-4605-a836-5668b8614559 tempest-VolumesSnapshotListTestJSON-157613269 None] Created reservations ['94930222-4c28-448d-a8cb-fe7bf5900287', '6e0140ee-a0b1-4317-93ca-c558459fa693', 'f3c4fc00-e28c-4dfe-9978-6527536583b1', '6fcdd15a-56b4-4cd3-bb82-165dc937c908'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:21:15 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_539ab3ea-534d-41c6-b08f-35843a922aae_sw6j3nf2" returned: 0 in 0.364s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_539ab3ea-534d-41c6-b08f-35843a922aae_sw6j3nf2 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:15 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4 1073741824" returned: 0 in 0.527s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ed0f4edd-6ec2-4605-a836-5668b8614559 tempest-VolumesSnapshotListTestJSON-157613269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ed0f4edd-6ec2-4605-a836-5668b8614559 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ed0f4edd-6ec2-4605-a836-5668b8614559 tempest-VolumesSnapshotListTestJSON-157613269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ed0f4edd-6ec2-4605-a836-5668b8614559 tempest-VolumesSnapshotListTestJSON-157613269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ed0f4edd-6ec2-4605-a836-5668b8614559 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ed0f4edd-6ec2-4605-a836-5668b8614559 tempest-VolumesSnapshotListTestJSON-157613269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:15 devstack sudo[102857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:21:15 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:15 devstack sudo[102858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4
Sep 28 18:21:15 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:15 devstack sudo[102856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_539ab3ea-534d-41c6-b08f-35843a922aae_sw6j3nf2
Sep 28 18:21:15 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:16 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ed0f4edd-6ec2-4605-a836-5668b8614559 tempest-VolumesSnapshotListTestJSON-157613269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.297s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-ed0f4edd-6ec2-4605-a836-5668b8614559 tempest-VolumesSnapshotListTestJSON-157613269 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:21:16 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-ed0f4edd-6ec2-4605-a836-5668b8614559 tempest-VolumesSnapshotListTestJSON-157613269 None] Deleted volume successfully.
Sep 28 18:21:16 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ed0f4edd-6ec2-4605-a836-5668b8614559 tempest-VolumesSnapshotListTestJSON-157613269 None] Lock "cinder-defafa74-6762-4332-aebe-28b6789824d3-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4" returned: 0 in 0.332s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:16 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.735s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-469556611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c11d1b-d0e8-4ff8-a518-29d7867fe106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f543a3c68664b4cb0793e1557b9a6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:13Z,use_quota=True,user_id='2233b45ea4aa4d26b8bc27a3fb959fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Creating volume e7c11d1b-d0e8-4ff8-a518-29d7867fe106 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:21:16 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e7c11d1b-d0e8-4ff8-a518-29d7867fe106 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_539ab3ea-534d-41c6-b08f-35843a922aae_sw6j3nf2" returned: 1 in 0.465s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_539ab3ea-534d-41c6-b08f-35843a922aae_sw6j3nf2' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e4ee6f-b6b2-424d-88ed-c08db06ad07f]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:16 devstack sudo[102866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e7c11d1b-d0e8-4ff8-a518-29d7867fe106 1073741824
Sep 28 18:21:16 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e8b846-efd9-42d8-ab77-250ae5958682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead4b843-5ed1-435e-b317-c918da38e9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:16 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Volume volume-63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4 (63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4): created successfully
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead4b843-5ed1-435e-b317-c918da38e9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Flow 'volume_create_manager' (2358b98d-bc11-4fc8-85b1-be65fa71cef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:16 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-29e01b32-8a2e-446c-9177-6bffd87b8379 tempest-CreateVolumesFromSnapshotTest-522091956 None] Created volume successfully.
Sep 28 18:21:16 devstack sudo[102867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD
Sep 28 18:21:16 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:16 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:16 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e7c11d1b-d0e8-4ff8-a518-29d7867fe106 1073741824" returned: 0 in 0.499s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:16 devstack sudo[102875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD
Sep 28 18:21:16 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e7c11d1b-d0e8-4ff8-a518-29d7867fe106 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:16 devstack sudo[102877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e7c11d1b-d0e8-4ff8-a518-29d7867fe106
Sep 28 18:21:16 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:16 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD" returned: 1 in 0.448s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] 539ab3ea-534d-41c6-b08f-35843a922aae was raw, converting to qcow2 {{(pid=87046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 28 18:21:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-320a1946-ad00-4f54-8c21-42acfacfc981 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:17 devstack sudo[102883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-320a1946-ad00-4f54-8c21-42acfacfc981
Sep 28 18:21:17 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:17 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e7c11d1b-d0e8-4ff8-a518-29d7867fe106" returned: 0 in 0.391s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:21:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.241s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-128134207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=374038a6-b68a-42ce-b553-7f1647c9b199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f543a3c68664b4cb0793e1557b9a6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:14Z,use_quota=True,user_id='2233b45ea4aa4d26b8bc27a3fb959fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:21:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Creating volume 374038a6-b68a-42ce-b553-7f1647c9b199 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:21:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:21:17 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:21:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-374038a6-b68a-42ce-b553-7f1647c9b199 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f34293-2a76-4935-9081-617fc76141bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7c11d1b-d0e8-4ff8-a518-29d7867fe106', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f96f0ff-fe5e-4c25-969a-ace8b9c5ccf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:17 devstack sudo[102885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-374038a6-b68a-42ce-b553-7f1647c9b199 1073741824
Sep 28 18:21:17 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:17 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Volume volume-e7c11d1b-d0e8-4ff8-a518-29d7867fe106 (e7c11d1b-d0e8-4ff8-a518-29d7867fe106): created successfully
Sep 28 18:21:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f96f0ff-fe5e-4c25-969a-ace8b9c5ccf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Flow 'volume_create_manager' (e7a5d7a7-484c-43b1-93d8-c4c4adad3a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:17 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-38345ddf-4dd9-4424-b49d-fed7e1bf406b tempest-CreateVolumesFromSnapshotTest-522091956 None] Created volume successfully.
Sep 28 18:21:17 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-320a1946-ad00-4f54-8c21-42acfacfc981" returned: 0 in 0.681s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:17 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_539ab3ea-534d-41c6-b08f-35843a922aae_lipkhoa8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-320a1946-ad00-4f54-8c21-42acfacfc981 {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:21:17 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Converted 0.00 MB image at 0.00 MB/s
Sep 28 18:21:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-320a1946-ad00-4f54-8c21-42acfacfc981 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:17 devstack sudo[102895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-320a1946-ad00-4f54-8c21-42acfacfc981 1G
Sep 28 18:21:17 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:17 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-374038a6-b68a-42ce-b553-7f1647c9b199 1073741824" returned: 0 in 0.652s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-374038a6-b68a-42ce-b553-7f1647c9b199 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:17 devstack sudo[102897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-374038a6-b68a-42ce-b553-7f1647c9b199
Sep 28 18:21:17 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:18 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-320a1946-ad00-4f54-8c21-42acfacfc981 1G" returned: 0 in 0.458s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Downloaded image 539ab3ea-534d-41c6-b08f-35843a922aae ((None, [{'url': 'file:///opt/stack/data/glance/images/539ab3ea-534d-41c6-b08f-35843a922aae', 'metadata': {}}])) to volume 320a1946-ad00-4f54-8c21-42acfacfc981 successfully. {{(pid=87046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Temporary image 539ab3ea-534d-41c6-b08f-35843a922aae for user 5e187d09d0ed442a9f20200e06ac4d8c is deleted. {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Marking volume 320a1946-ad00-4f54-8c21-42acfacfc981 as bootable. {{(pid=87046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Copying metadata from image 539ab3ea-534d-41c6-b08f-35843a922aae to 320a1946-ad00-4f54-8c21-42acfacfc981. {{(pid=87046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Creating volume glance metadata for volume 320a1946-ad00-4f54-8c21-42acfacfc981 backed by image 539ab3ea-534d-41c6-b08f-35843a922aae with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '539ab3ea-534d-41c6-b08f-35843a922aae', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '24e4e2d01ad38e476a5fbb8e88bd3d14', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 28 18:21:18 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-374038a6-b68a-42ce-b553-7f1647c9b199" returned: 0 in 0.337s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe57310c-f3e1-4ae4-876b-342a7f865dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-374038a6-b68a-42ce-b553-7f1647c9b199', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188c6e25-403d-4219-bcff-653702b9eb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:18 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Volume volume-374038a6-b68a-42ce-b553-7f1647c9b199 (374038a6-b68a-42ce-b553-7f1647c9b199): created successfully
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188c6e25-403d-4219-bcff-653702b9eb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Flow 'volume_create_manager' (160905f4-c7ea-495c-ba4f-db8632701253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:18 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-98003639-adbf-44ee-a868-06223774b0f3 tempest-CreateVolumesFromSnapshotTest-522091956 None] Created volume successfully.
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0af1d5-9676-442e-9dc6-81dddc0d758d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-320a1946-ad00-4f54-8c21-42acfacfc981', 'volume_size': 1, 'image_id': '539ab3ea-534d-41c6-b08f-35843a922aae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/539ab3ea-534d-41c6-b08f-35843a922aae', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '24e4e2d01ad38e476a5fbb8e88bd3d14', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '255167336cca4e538d8d1bdea8a760e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0e063f419f986aa36b1ac5f392bbabdefc5a29002c469043eb32c472bb0aed0ce476bff596807c7e8f3dd52855e866f6562f77d87f7d0711a8deec2817def5f9', 'id': '539ab3ea-534d-41c6-b08f-35843a922aae', 'created_at': datetime.datetime(2026, 9, 28, 16, 21, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 21, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539ab3ea-534d-41c6-b08f-35843a922aae/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aa4aed1c0>}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f505d7-63ac-4fa7-a1a3-2a51a1b6dedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:18 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Volume volume-320a1946-ad00-4f54-8c21-42acfacfc981 (320a1946-ad00-4f54-8c21-42acfacfc981): created successfully
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f505d7-63ac-4fa7-a1a3-2a51a1b6dedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Flow 'volume_create_manager' (645909ab-7bbf-4e13-9db1-e0c657d56a26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:18 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-2f157fec-09ba-4305-bb5c-4c855ff81793 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Created volume successfully.
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f968dcc6-d785-4396-9ce8-1e363c2ea9a0 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Acquiring lock "cinder-320a1946-ad00-4f54-8c21-42acfacfc981-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f968dcc6-d785-4396-9ce8-1e363c2ea9a0 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Lock "cinder-320a1946-ad00-4f54-8c21-42acfacfc981-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f968dcc6-d785-4396-9ce8-1e363c2ea9a0 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Acquiring lock "cinder-quobyte-320a1946-ad00-4f54-8c21-42acfacfc981" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f968dcc6-d785-4396-9ce8-1e363c2ea9a0 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Lock "cinder-quobyte-320a1946-ad00-4f54-8c21-42acfacfc981" acquired by "delete_volume" :: waited 0.016s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7dadda-1e89-48b7-89c4-3e9cb966e726]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f968dcc6-d785-4396-9ce8-1e363c2ea9a0 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-320a1946-ad00-4f54-8c21-42acfacfc981 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:18 devstack sudo[102904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-320a1946-ad00-4f54-8c21-42acfacfc981
Sep 28 18:21:18 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:19 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f968dcc6-d785-4396-9ce8-1e363c2ea9a0 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-320a1946-ad00-4f54-8c21-42acfacfc981" returned: 0 in 0.476s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f968dcc6-d785-4396-9ce8-1e363c2ea9a0 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-320a1946-ad00-4f54-8c21-42acfacfc981 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:19 devstack sudo[102910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-320a1946-ad00-4f54-8c21-42acfacfc981
Sep 28 18:21:19 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:19 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-365854ad-e7ce-43a8-9d68-7c92556367a8 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "cinder-374038a6-b68a-42ce-b553-7f1647c9b199-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:19 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-365854ad-e7ce-43a8-9d68-7c92556367a8 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-374038a6-b68a-42ce-b553-7f1647c9b199-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:19 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-365854ad-e7ce-43a8-9d68-7c92556367a8 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "cinder-quobyte-374038a6-b68a-42ce-b553-7f1647c9b199" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:19 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-365854ad-e7ce-43a8-9d68-7c92556367a8 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-quobyte-374038a6-b68a-42ce-b553-7f1647c9b199" acquired by "delete_volume" :: waited 0.018s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:19 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f968dcc6-d785-4396-9ce8-1e363c2ea9a0 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-320a1946-ad00-4f54-8c21-42acfacfc981" returned: 0 in 0.315s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:19 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f968dcc6-d785-4396-9ce8-1e363c2ea9a0 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Lock "cinder-quobyte-320a1946-ad00-4f54-8c21-42acfacfc981" released by "delete_volume" :: held 0.836s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:19 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c221b1-2d55-40aa-acb2-f96eb087af75]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-365854ad-e7ce-43a8-9d68-7c92556367a8 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-374038a6-b68a-42ce-b553-7f1647c9b199 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:19 devstack cinder-volume[87046]: WARNING cinder.quota [None req-f968dcc6-d785-4396-9ce8-1e363c2ea9a0 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:21:19 devstack cinder-volume[87046]: WARNING cinder.quota [None req-f968dcc6-d785-4396-9ce8-1e363c2ea9a0 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 28 18:21:19 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-f968dcc6-d785-4396-9ce8-1e363c2ea9a0 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Created reservations ['95697d8c-fce8-4cd2-8f05-1e1df6301966', '32ed5efc-196e-4041-933c-5be69b87e963', '0a14e92d-58a5-4d0b-b54f-7ee1f65cf5e5', '975de57a-c4ed-491a-9708-b0098f9a367d'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:21:19 devstack sudo[102913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-374038a6-b68a-42ce-b553-7f1647c9b199
Sep 28 18:21:19 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f968dcc6-d785-4396-9ce8-1e363c2ea9a0 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f968dcc6-d785-4396-9ce8-1e363c2ea9a0 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:19 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f968dcc6-d785-4396-9ce8-1e363c2ea9a0 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:19 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f968dcc6-d785-4396-9ce8-1e363c2ea9a0 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f968dcc6-d785-4396-9ce8-1e363c2ea9a0 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f968dcc6-d785-4396-9ce8-1e363c2ea9a0 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:19 devstack sudo[102915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:21:19 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:20 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f968dcc6-d785-4396-9ce8-1e363c2ea9a0 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.372s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:20 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-f968dcc6-d785-4396-9ce8-1e363c2ea9a0 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:21:20 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-f968dcc6-d785-4396-9ce8-1e363c2ea9a0 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Deleted volume successfully.
Sep 28 18:21:20 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-365854ad-e7ce-43a8-9d68-7c92556367a8 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-374038a6-b68a-42ce-b553-7f1647c9b199" returned: 0 in 0.662s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-365854ad-e7ce-43a8-9d68-7c92556367a8 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-374038a6-b68a-42ce-b553-7f1647c9b199 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:20 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f968dcc6-d785-4396-9ce8-1e363c2ea9a0 tempest-VolumeAndVolumeTypeFromImageTest-1906230669 None] Lock "cinder-320a1946-ad00-4f54-8c21-42acfacfc981-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:20 devstack sudo[102921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-374038a6-b68a-42ce-b553-7f1647c9b199
Sep 28 18:21:20 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:20 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-365854ad-e7ce-43a8-9d68-7c92556367a8 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-374038a6-b68a-42ce-b553-7f1647c9b199" returned: 0 in 0.445s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:20 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-365854ad-e7ce-43a8-9d68-7c92556367a8 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-quobyte-374038a6-b68a-42ce-b553-7f1647c9b199" released by "delete_volume" :: held 1.179s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:20 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-365854ad-e7ce-43a8-9d68-7c92556367a8 tempest-CreateVolumesFromSnapshotTest-522091956 None] Created reservations ['943ac4d3-c8b1-4cd0-9cf5-bc68533551f7', 'a15836bb-96f0-40e0-9e65-d9c0e37ce9d1', 'e942490a-5bc4-490a-8bcc-961fffac2562', '11ba13c9-21d1-4292-aab9-6142c8c29b9e'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:21:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-365854ad-e7ce-43a8-9d68-7c92556367a8 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-365854ad-e7ce-43a8-9d68-7c92556367a8 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-365854ad-e7ce-43a8-9d68-7c92556367a8 tempest-CreateVolumesFromSnapshotTest-522091956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-365854ad-e7ce-43a8-9d68-7c92556367a8 tempest-CreateVolumesFromSnapshotTest-522091956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-365854ad-e7ce-43a8-9d68-7c92556367a8 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-365854ad-e7ce-43a8-9d68-7c92556367a8 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:21 devstack sudo[102926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:21:21 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:21 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-365854ad-e7ce-43a8-9d68-7c92556367a8 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.387s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:21 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-365854ad-e7ce-43a8-9d68-7c92556367a8 tempest-CreateVolumesFromSnapshotTest-522091956 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:21:21 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-365854ad-e7ce-43a8-9d68-7c92556367a8 tempest-CreateVolumesFromSnapshotTest-522091956 None] Deleted volume successfully.
Sep 28 18:21:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-365854ad-e7ce-43a8-9d68-7c92556367a8 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-374038a6-b68a-42ce-b553-7f1647c9b199-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-940932ad-022a-4e3e-83cf-7414fe3b4401 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "cinder-e7c11d1b-d0e8-4ff8-a518-29d7867fe106-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-940932ad-022a-4e3e-83cf-7414fe3b4401 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-e7c11d1b-d0e8-4ff8-a518-29d7867fe106-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-940932ad-022a-4e3e-83cf-7414fe3b4401 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "cinder-quobyte-e7c11d1b-d0e8-4ff8-a518-29d7867fe106" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-940932ad-022a-4e3e-83cf-7414fe3b4401 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-quobyte-e7c11d1b-d0e8-4ff8-a518-29d7867fe106" acquired by "delete_volume" :: waited 0.030s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:21 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e945c2-b1d8-403b-a24b-a2449a1a1d28]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-940932ad-022a-4e3e-83cf-7414fe3b4401 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e7c11d1b-d0e8-4ff8-a518-29d7867fe106 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:22 devstack sudo[102929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e7c11d1b-d0e8-4ff8-a518-29d7867fe106
Sep 28 18:21:22 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:22 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-940932ad-022a-4e3e-83cf-7414fe3b4401 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e7c11d1b-d0e8-4ff8-a518-29d7867fe106" returned: 0 in 0.516s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-940932ad-022a-4e3e-83cf-7414fe3b4401 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e7c11d1b-d0e8-4ff8-a518-29d7867fe106 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:22 devstack sudo[102934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e7c11d1b-d0e8-4ff8-a518-29d7867fe106
Sep 28 18:21:22 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:22 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-940932ad-022a-4e3e-83cf-7414fe3b4401 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e7c11d1b-d0e8-4ff8-a518-29d7867fe106" returned: 0 in 0.292s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-940932ad-022a-4e3e-83cf-7414fe3b4401 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-quobyte-e7c11d1b-d0e8-4ff8-a518-29d7867fe106" released by "delete_volume" :: held 0.887s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:22 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-940932ad-022a-4e3e-83cf-7414fe3b4401 tempest-CreateVolumesFromSnapshotTest-522091956 None] Created reservations ['87e563f1-531d-4607-8d95-6ebd66e30561', '58c81b01-3994-4041-a5c6-ff98355ac97e', '9facdb0e-f46c-4930-b794-01f2f692f274', '237a9dad-cc1a-4be1-a6cb-5ad0de0dcc13'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:21:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-940932ad-022a-4e3e-83cf-7414fe3b4401 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-940932ad-022a-4e3e-83cf-7414fe3b4401 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:23 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-940932ad-022a-4e3e-83cf-7414fe3b4401 tempest-CreateVolumesFromSnapshotTest-522091956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:23 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-940932ad-022a-4e3e-83cf-7414fe3b4401 tempest-CreateVolumesFromSnapshotTest-522091956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-940932ad-022a-4e3e-83cf-7414fe3b4401 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-940932ad-022a-4e3e-83cf-7414fe3b4401 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:23 devstack sudo[102939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:21:23 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-52f70d63-592d-49ac-8483-65acbfa314a0 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "cinder-63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-52f70d63-592d-49ac-8483-65acbfa314a0 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-52f70d63-592d-49ac-8483-65acbfa314a0 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "cinder-quobyte-63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-52f70d63-592d-49ac-8483-65acbfa314a0 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-quobyte-63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4" acquired by "delete_volume" :: waited 0.025s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:23 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97befda-4a76-43bf-8892-549f636c6df3]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-52f70d63-592d-49ac-8483-65acbfa314a0 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:23 devstack sudo[102941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4
Sep 28 18:21:23 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:23 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-940932ad-022a-4e3e-83cf-7414fe3b4401 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.510s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:23 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-940932ad-022a-4e3e-83cf-7414fe3b4401 tempest-CreateVolumesFromSnapshotTest-522091956 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:21:23 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-940932ad-022a-4e3e-83cf-7414fe3b4401 tempest-CreateVolumesFromSnapshotTest-522091956 None] Deleted volume successfully.
Sep 28 18:21:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-940932ad-022a-4e3e-83cf-7414fe3b4401 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-e7c11d1b-d0e8-4ff8-a518-29d7867fe106-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:23 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-52f70d63-592d-49ac-8483-65acbfa314a0 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4" returned: 0 in 0.595s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-52f70d63-592d-49ac-8483-65acbfa314a0 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:23 devstack sudo[102947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4
Sep 28 18:21:23 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:24 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-52f70d63-592d-49ac-8483-65acbfa314a0 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4" returned: 0 in 0.367s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-52f70d63-592d-49ac-8483-65acbfa314a0 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-quobyte-63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4" released by "delete_volume" :: held 1.042s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:24 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-52f70d63-592d-49ac-8483-65acbfa314a0 tempest-CreateVolumesFromSnapshotTest-522091956 None] Created reservations ['afc04a8c-9f78-4fac-961d-0ef6a93d02ed', 'b2f339fd-8e75-42f6-bb33-525603bde561', '48a9fc4c-4d90-4423-9cf3-c893d78cf2ce', 'd08204f0-41da-4947-a782-268fcf66b54d'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:21:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-52f70d63-592d-49ac-8483-65acbfa314a0 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-52f70d63-592d-49ac-8483-65acbfa314a0 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-52f70d63-592d-49ac-8483-65acbfa314a0 tempest-CreateVolumesFromSnapshotTest-522091956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-52f70d63-592d-49ac-8483-65acbfa314a0 tempest-CreateVolumesFromSnapshotTest-522091956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-52f70d63-592d-49ac-8483-65acbfa314a0 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-52f70d63-592d-49ac-8483-65acbfa314a0 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:24 devstack sudo[102950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:21:24 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:24 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-52f70d63-592d-49ac-8483-65acbfa314a0 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.376s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:24 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-52f70d63-592d-49ac-8483-65acbfa314a0 tempest-CreateVolumesFromSnapshotTest-522091956 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:21:24 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-52f70d63-592d-49ac-8483-65acbfa314a0 tempest-CreateVolumesFromSnapshotTest-522091956 None] Deleted volume successfully.
Sep 28 18:21:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-52f70d63-592d-49ac-8483-65acbfa314a0 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-63e746c1-1ba3-4f1a-a3d2-e4f5ab4c0bf4-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1d39d290-ac7a-45e7-abd0-0a0e08045726 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "cinder-0c824363-d71e-4a38-97b6-017cdd7d5d17-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1d39d290-ac7a-45e7-abd0-0a0e08045726 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-0c824363-d71e-4a38-97b6-017cdd7d5d17-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1d39d290-ac7a-45e7-abd0-0a0e08045726 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "cinder-quobyte-0c824363-d71e-4a38-97b6-017cdd7d5d17" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1d39d290-ac7a-45e7-abd0-0a0e08045726 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-quobyte-0c824363-d71e-4a38-97b6-017cdd7d5d17" acquired by "delete_volume" :: waited 0.025s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:25 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1832c35b-d1f6-400a-a3f0-efcc970beb50]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1d39d290-ac7a-45e7-abd0-0a0e08045726 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0c824363-d71e-4a38-97b6-017cdd7d5d17 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:25 devstack sudo[102954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0c824363-d71e-4a38-97b6-017cdd7d5d17
Sep 28 18:21:25 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:26 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1d39d290-ac7a-45e7-abd0-0a0e08045726 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0c824363-d71e-4a38-97b6-017cdd7d5d17" returned: 0 in 0.490s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1d39d290-ac7a-45e7-abd0-0a0e08045726 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0c824363-d71e-4a38-97b6-017cdd7d5d17 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:26 devstack sudo[102959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0c824363-d71e-4a38-97b6-017cdd7d5d17
Sep 28 18:21:26 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:26 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1d39d290-ac7a-45e7-abd0-0a0e08045726 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0c824363-d71e-4a38-97b6-017cdd7d5d17" returned: 0 in 0.293s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:26 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1d39d290-ac7a-45e7-abd0-0a0e08045726 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-quobyte-0c824363-d71e-4a38-97b6-017cdd7d5d17" released by "delete_volume" :: held 0.841s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:26 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-1d39d290-ac7a-45e7-abd0-0a0e08045726 tempest-CreateVolumesFromSnapshotTest-522091956 None] Created reservations ['e64b4af3-cf09-46cc-9195-13cf112c70de', 'fa7e6a15-0ca6-4f61-b1e4-831ed6fd4e56', 'bf2938e9-f3be-4087-802a-669af2a36739', '25063cf6-31a9-4755-9ae0-4f10f3fc240e'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:21:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1d39d290-ac7a-45e7-abd0-0a0e08045726 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1d39d290-ac7a-45e7-abd0-0a0e08045726 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1d39d290-ac7a-45e7-abd0-0a0e08045726 tempest-CreateVolumesFromSnapshotTest-522091956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1d39d290-ac7a-45e7-abd0-0a0e08045726 tempest-CreateVolumesFromSnapshotTest-522091956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1d39d290-ac7a-45e7-abd0-0a0e08045726 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1d39d290-ac7a-45e7-abd0-0a0e08045726 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:26 devstack sudo[102962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:21:26 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:26 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a2d8c6b2-5e1c-425a-a9ca-3cbec4c312bc tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "cinder-0e2b7409-7300-4f1d-b56a-3f66d41aa6f8-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:26 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a2d8c6b2-5e1c-425a-a9ca-3cbec4c312bc tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-0e2b7409-7300-4f1d-b56a-3f66d41aa6f8-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:26 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a2d8c6b2-5e1c-425a-a9ca-3cbec4c312bc tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "cinder-quobyte-0e2b7409-7300-4f1d-b56a-3f66d41aa6f8" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:26 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a2d8c6b2-5e1c-425a-a9ca-3cbec4c312bc tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-quobyte-0e2b7409-7300-4f1d-b56a-3f66d41aa6f8" acquired by "delete_volume" :: waited 0.025s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff24060-fd51-47e7-a9e3-40dc20b9acbe]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a2d8c6b2-5e1c-425a-a9ca-3cbec4c312bc tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e2b7409-7300-4f1d-b56a-3f66d41aa6f8 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:27 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1d39d290-ac7a-45e7-abd0-0a0e08045726 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.494s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-1d39d290-ac7a-45e7-abd0-0a0e08045726 tempest-CreateVolumesFromSnapshotTest-522091956 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:21:27 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-1d39d290-ac7a-45e7-abd0-0a0e08045726 tempest-CreateVolumesFromSnapshotTest-522091956 None] Deleted volume successfully.
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1d39d290-ac7a-45e7-abd0-0a0e08045726 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-0c824363-d71e-4a38-97b6-017cdd7d5d17-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:27 devstack sudo[102965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e2b7409-7300-4f1d-b56a-3f66d41aa6f8
Sep 28 18:21:27 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Flow 'volume_create_manager' (50bcc6f7-f224-4eeb-8557-6733405496d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc65b555-b99e-4801-b05f-2a9c71e18849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc65b555-b99e-4801-b05f-2a9c71e18849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2039241474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=888a0bb8-ef54-4156-8715-c4d8b9f80f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78b7dfbffe64853ac9cf5469607ea06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:27Z,use_quota=True,user_id='b6a0cc7bc5154d759e4499f2cb43bd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af81042-58d7-4c0a-bd89-2b6f332aa1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af81042-58d7-4c0a-bd89-2b6f332aa1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34eaa1b-372a-4549-b334-a585d0b4779f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34eaa1b-372a-4549-b334-a585d0b4779f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '888a0bb8-ef54-4156-8715-c4d8b9f80f09', 'volume_name': 'volume-888a0bb8-ef54-4156-8715-c4d8b9f80f09', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23fb11b-18c9-4966-8a8c-bddd0226ac83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23fb11b-18c9-4966-8a8c-bddd0226ac83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e373eba-963a-4f87-9799-a6b9614682ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:27 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Volume 888a0bb8-ef54-4156-8715-c4d8b9f80f09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-888a0bb8-ef54-4156-8715-c4d8b9f80f09', 'volume_size': 1}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2039241474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=888a0bb8-ef54-4156-8715-c4d8b9f80f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78b7dfbffe64853ac9cf5469607ea06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:27Z,use_quota=True,user_id='b6a0cc7bc5154d759e4499f2cb43bd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Creating volume 888a0bb8-ef54-4156-8715-c4d8b9f80f09 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:21:27 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-888a0bb8-ef54-4156-8715-c4d8b9f80f09 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:27 devstack sudo[102969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-888a0bb8-ef54-4156-8715-c4d8b9f80f09 1073741824
Sep 28 18:21:27 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:27 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a2d8c6b2-5e1c-425a-a9ca-3cbec4c312bc tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e2b7409-7300-4f1d-b56a-3f66d41aa6f8" returned: 0 in 0.512s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a2d8c6b2-5e1c-425a-a9ca-3cbec4c312bc tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e2b7409-7300-4f1d-b56a-3f66d41aa6f8 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:27 devstack sudo[102972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e2b7409-7300-4f1d-b56a-3f66d41aa6f8
Sep 28 18:21:27 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:27 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a2d8c6b2-5e1c-425a-a9ca-3cbec4c312bc tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0e2b7409-7300-4f1d-b56a-3f66d41aa6f8" returned: 0 in 0.335s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a2d8c6b2-5e1c-425a-a9ca-3cbec4c312bc tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-quobyte-0e2b7409-7300-4f1d-b56a-3f66d41aa6f8" released by "delete_volume" :: held 0.943s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:27 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-a2d8c6b2-5e1c-425a-a9ca-3cbec4c312bc tempest-CreateVolumesFromSnapshotTest-522091956 None] Created reservations ['a566519c-3a38-4cb1-b67f-bb0e3c9ab8db', '41263c0c-142a-47ef-a97f-ea3ccb6de408', '5d470e9f-59d9-4253-8dd2-2decb3b69fa9', 'f9702c55-c46f-40df-9c00-bea655ebe237'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:21:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a2d8c6b2-5e1c-425a-a9ca-3cbec4c312bc tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a2d8c6b2-5e1c-425a-a9ca-3cbec4c312bc tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:28 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a2d8c6b2-5e1c-425a-a9ca-3cbec4c312bc tempest-CreateVolumesFromSnapshotTest-522091956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:28 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a2d8c6b2-5e1c-425a-a9ca-3cbec4c312bc tempest-CreateVolumesFromSnapshotTest-522091956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a2d8c6b2-5e1c-425a-a9ca-3cbec4c312bc tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a2d8c6b2-5e1c-425a-a9ca-3cbec4c312bc tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:28 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-888a0bb8-ef54-4156-8715-c4d8b9f80f09 1073741824" returned: 0 in 0.657s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:28 devstack sudo[102979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:21:28 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-888a0bb8-ef54-4156-8715-c4d8b9f80f09 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:28 devstack sudo[102981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-888a0bb8-ef54-4156-8715-c4d8b9f80f09
Sep 28 18:21:28 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:28 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a2d8c6b2-5e1c-425a-a9ca-3cbec4c312bc tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.354s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:28 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-a2d8c6b2-5e1c-425a-a9ca-3cbec4c312bc tempest-CreateVolumesFromSnapshotTest-522091956 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:21:28 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-a2d8c6b2-5e1c-425a-a9ca-3cbec4c312bc tempest-CreateVolumesFromSnapshotTest-522091956 None] Deleted volume successfully.
Sep 28 18:21:28 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a2d8c6b2-5e1c-425a-a9ca-3cbec4c312bc tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-0e2b7409-7300-4f1d-b56a-3f66d41aa6f8-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:28 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-888a0bb8-ef54-4156-8715-c4d8b9f80f09" returned: 0 in 0.423s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:28 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:21:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e373eba-963a-4f87-9799-a6b9614682ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-888a0bb8-ef54-4156-8715-c4d8b9f80f09', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc767ef-368b-499d-a546-b3b9be14fa35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:28 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Volume volume-888a0bb8-ef54-4156-8715-c4d8b9f80f09 (888a0bb8-ef54-4156-8715-c4d8b9f80f09): created successfully
Sep 28 18:21:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc767ef-368b-499d-a546-b3b9be14fa35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Flow 'volume_create_manager' (50bcc6f7-f224-4eeb-8557-6733405496d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:28 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-e8869416-ca0e-490d-bf8c-e99c5c0e9fe0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Created volume successfully.
Sep 28 18:21:29 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b3f84754-dcaf-4b03-987d-d7782d00bdf4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "cinder-49382975-5c60-4d4f-8503-747eb2a60014-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:29 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b3f84754-dcaf-4b03-987d-d7782d00bdf4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-49382975-5c60-4d4f-8503-747eb2a60014-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:29 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b3f84754-dcaf-4b03-987d-d7782d00bdf4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "cinder-quobyte-05d10fa7-c949-4bfc-b6ce-5cb929676488" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:29 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b3f84754-dcaf-4b03-987d-d7782d00bdf4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-quobyte-05d10fa7-c949-4bfc-b6ce-5cb929676488" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:29 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b3f84754-dcaf-4b03-987d-d7782d00bdf4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "cinder-quobyte-49382975-5c60-4d4f-8503-747eb2a60014" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:29 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b3f84754-dcaf-4b03-987d-d7782d00bdf4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-quobyte-49382975-5c60-4d4f-8503-747eb2a60014" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-b3f84754-dcaf-4b03-987d-d7782d00bdf4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Deleting offline snapshot 49382975-5c60-4d4f-8503-747eb2a60014 of volume 05d10fa7-c949-4bfc-b6ce-5cb929676488 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:21:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-b3f84754-dcaf-4b03-987d-d7782d00bdf4 tempest-CreateVolumesFromSnapshotTest-522091956 None] snapshot_file for this snap is: volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.49382975-5c60-4d4f-8503-747eb2a60014 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:21:29 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66344e1-7786-46eb-befb-dd71e1da556a]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b3f84754-dcaf-4b03-987d-d7782d00bdf4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.49382975-5c60-4d4f-8503-747eb2a60014 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:29 devstack sudo[103000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.49382975-5c60-4d4f-8503-747eb2a60014
Sep 28 18:21:29 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:30 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b3f84754-dcaf-4b03-987d-d7782d00bdf4 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.49382975-5c60-4d4f-8503-747eb2a60014" returned: 0 in 0.856s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-b3f84754-dcaf-4b03-987d-d7782d00bdf4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d10fa7-c949-4bfc-b6ce-5cb929676488(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Flow 'volume_create_manager' (fde42d4d-a1a6-4371-b2f5-b9bb5a932844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06569eb-6f95-40e2-94c0-6e0b6fefeb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87f5cbb-778c-4dc1-b7b4-6b8d26311200]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b3f84754-dcaf-4b03-987d-d7782d00bdf4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06569eb-6f95-40e2-94c0-6e0b6fefeb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1393139330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01d3b52-c549-47be-861f-5c7111a1a7ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78b7dfbffe64853ac9cf5469607ea06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:30Z,use_quota=True,user_id='b6a0cc7bc5154d759e4499f2cb43bd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c515267-01cf-44e7-b63a-8f41f6123c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c515267-01cf-44e7-b63a-8f41f6123c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291ea317-70cd-49d6-943c-d02ea2c8d445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291ea317-70cd-49d6-943c-d02ea2c8d445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a01d3b52-c549-47be-861f-5c7111a1a7ee', 'volume_name': 'volume-a01d3b52-c549-47be-861f-5c7111a1a7ee', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (286c8c1a-9b57-4e69-950b-7cb1bcaf74c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (286c8c1a-9b57-4e69-950b-7cb1bcaf74c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17bf1a8-e86a-4cdf-ad7b-005a24fc9147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:30 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Volume a01d3b52-c549-47be-861f-5c7111a1a7ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a01d3b52-c549-47be-861f-5c7111a1a7ee', 'volume_size': 1}
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:30 devstack sudo[103027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1393139330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01d3b52-c549-47be-861f-5c7111a1a7ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78b7dfbffe64853ac9cf5469607ea06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:30Z,use_quota=True,user_id='b6a0cc7bc5154d759e4499f2cb43bd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:21:30 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Creating volume a01d3b52-c549-47be-861f-5c7111a1a7ee {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:21:30 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:21:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a01d3b52-c549-47be-861f-5c7111a1a7ee 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:30 devstack sudo[103029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a01d3b52-c549-47be-861f-5c7111a1a7ee 1073741824
Sep 28 18:21:30 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:31 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:21:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Flow 'volume_create_manager' (56412761-9b7d-4b8d-ba4e-f6e124e6c6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:31 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567ac6bd-f0ee-4132-910b-3b6217a22d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b3f84754-dcaf-4b03-987d-d7782d00bdf4 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488" returned: 0 in 0.792s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b3f84754-dcaf-4b03-987d-d7782d00bdf4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.49382975-5c60-4d4f-8503-747eb2a60014 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567ac6bd-f0ee-4132-910b-3b6217a22d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-306672596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4923e1-46fd-4449-99f9-9037de61b811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78b7dfbffe64853ac9cf5469607ea06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:31Z,use_quota=True,user_id='b6a0cc7bc5154d759e4499f2cb43bd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c3d45d-4291-49fa-b93f-072d5beb1eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c3d45d-4291-49fa-b93f-072d5beb1eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:31 devstack sudo[103037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.49382975-5c60-4d4f-8503-747eb2a60014
Sep 28 18:21:31 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33298ee6-4303-4e32-83f8-4d9b4f4b20dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33298ee6-4303-4e32-83f8-4d9b4f4b20dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d4923e1-46fd-4449-99f9-9037de61b811', 'volume_name': 'volume-8d4923e1-46fd-4449-99f9-9037de61b811', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec428f7c-bcff-4d00-9b2e-76bd24d4e57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec428f7c-bcff-4d00-9b2e-76bd24d4e57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7edca1b3-35a6-4114-8962-3464b736a116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:31 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Volume 8d4923e1-46fd-4449-99f9-9037de61b811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d4923e1-46fd-4449-99f9-9037de61b811', 'volume_size': 1}
Sep 28 18:21:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:31 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a01d3b52-c549-47be-861f-5c7111a1a7ee 1073741824" returned: 0 in 0.958s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a01d3b52-c549-47be-861f-5c7111a1a7ee {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:31 devstack sudo[103042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a01d3b52-c549-47be-861f-5c7111a1a7ee
Sep 28 18:21:31 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:31 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:21:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Flow 'volume_create_manager' (9b8c4d32-f225-4573-a5b5-9c2ef1cd2849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9c7afd-a39f-4614-bbd4-26f6fcc4e9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9c7afd-a39f-4614-bbd4-26f6fcc4e9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-215324517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4dfe501-a7c4-45a6-bad6-bf85117c9add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78b7dfbffe64853ac9cf5469607ea06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:32Z,use_quota=True,user_id='b6a0cc7bc5154d759e4499f2cb43bd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a182ddf-d91e-437c-ae80-0c5abeed585f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:31 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a182ddf-d91e-437c-ae80-0c5abeed585f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ff11e4-d16d-4bf5-956d-bc3f87aed0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ff11e4-d16d-4bf5-956d-bc3f87aed0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4dfe501-a7c4-45a6-bad6-bf85117c9add', 'volume_name': 'volume-d4dfe501-a7c4-45a6-bad6-bf85117c9add', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e9f6029-cb42-461f-90f9-8f1d2f4a375f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e9f6029-cb42-461f-90f9-8f1d2f4a375f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f56cac0-c060-470e-9fd2-d672ba3b9b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:32 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Volume d4dfe501-a7c4-45a6-bad6-bf85117c9add: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4dfe501-a7c4-45a6-bad6-bf85117c9add', 'volume_size': 1}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b3f84754-dcaf-4b03-987d-d7782d00bdf4 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.49382975-5c60-4d4f-8503-747eb2a60014" returned: 0 in 0.846s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b3f84754-dcaf-4b03-987d-d7782d00bdf4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.49382975-5c60-4d4f-8503-747eb2a60014 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:32 devstack sudo[103045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.49382975-5c60-4d4f-8503-747eb2a60014
Sep 28 18:21:32 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:32 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a01d3b52-c549-47be-861f-5c7111a1a7ee" returned: 0 in 0.567s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.933s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-306672596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4923e1-46fd-4449-99f9-9037de61b811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78b7dfbffe64853ac9cf5469607ea06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:31Z,use_quota=True,user_id='b6a0cc7bc5154d759e4499f2cb43bd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Creating volume 8d4923e1-46fd-4449-99f9-9037de61b811 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:21:32 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8d4923e1-46fd-4449-99f9-9037de61b811 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:32 devstack sudo[103048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8d4923e1-46fd-4449-99f9-9037de61b811 1073741824
Sep 28 18:21:32 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17bf1a8-e86a-4cdf-ad7b-005a24fc9147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a01d3b52-c549-47be-861f-5c7111a1a7ee', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c9f1c3-cc8c-4d7f-8e21-6e18cf626ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:32 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Volume volume-a01d3b52-c549-47be-861f-5c7111a1a7ee (a01d3b52-c549-47be-861f-5c7111a1a7ee): created successfully
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c9f1c3-cc8c-4d7f-8e21-6e18cf626ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Flow 'volume_create_manager' (fde42d4d-a1a6-4371-b2f5-b9bb5a932844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:32 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-a30636a8-4df2-46a2-ab3e-be5e346f19c3 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Created volume successfully.
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Flow 'volume_create_manager' (1e849b9c-8037-4ce8-8a27-3285b6309625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd05a71-d3e6-4266-bd21-3dd008d17741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd05a71-d3e6-4266-bd21-3dd008d17741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-670592614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99477fad-d735-4884-abda-734e7b0ed8dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78b7dfbffe64853ac9cf5469607ea06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:32Z,use_quota=True,user_id='b6a0cc7bc5154d759e4499f2cb43bd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9660342e-cbe0-4730-9774-f90d36dcd6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9660342e-cbe0-4730-9774-f90d36dcd6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6544949a-16aa-4d64-8d88-04e969569e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6544949a-16aa-4d64-8d88-04e969569e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99477fad-d735-4884-abda-734e7b0ed8dd', 'volume_name': 'volume-99477fad-d735-4884-abda-734e7b0ed8dd', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498cc3d4-e9ab-4edf-96d8-3dc54f14b51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498cc3d4-e9ab-4edf-96d8-3dc54f14b51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e39321-e59d-4ec2-8056-cd9fb1cf56b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:32 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Volume 99477fad-d735-4884-abda-734e7b0ed8dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99477fad-d735-4884-abda-734e7b0ed8dd', 'volume_size': 1}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:32 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b3f84754-dcaf-4b03-987d-d7782d00bdf4 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488.49382975-5c60-4d4f-8503-747eb2a60014" returned: 0 in 0.631s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b3f84754-dcaf-4b03-987d-d7782d00bdf4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-quobyte-49382975-5c60-4d4f-8503-747eb2a60014" released by "_delete_snapshot" :: held 3.476s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:32 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b3f84754-dcaf-4b03-987d-d7782d00bdf4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-quobyte-05d10fa7-c949-4bfc-b6ce-5cb929676488" released by "delete_snapshot" :: held 3.517s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-b3f84754-dcaf-4b03-987d-d7782d00bdf4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Created reservations ['594660a9-1519-475f-aa37-42521187c470', 'b414d698-06e4-4d42-b4b1-1238f39b9297', 'd8bc882f-6e51-4bee-b39b-7f68446807f2', '0d9df4c6-626e-4c8d-91d9-1dc8e2890728'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:21:33 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-b3f84754-dcaf-4b03-987d-d7782d00bdf4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Delete snapshot completed successfully.
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b3f84754-dcaf-4b03-987d-d7782d00bdf4 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-49382975-5c60-4d4f-8503-747eb2a60014-delete_snapshot" released by "delete_snapshot" :: held 3.967s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:33 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8d4923e1-46fd-4449-99f9-9037de61b811 1073741824" returned: 0 in 1.080s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Flow 'volume_create_manager' (9f962b0e-7595-439d-aa95-c91f6e5452b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ab766b-d84b-4dad-a536-c46d679eaf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8d4923e1-46fd-4449-99f9-9037de61b811 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ab766b-d84b-4dad-a536-c46d679eaf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-837816006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f522dd-390c-4158-b50e-7656c12a8d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78b7dfbffe64853ac9cf5469607ea06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:33Z,use_quota=True,user_id='b6a0cc7bc5154d759e4499f2cb43bd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9609405-9657-4b69-991a-4067134cc116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:33 devstack sudo[103056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8d4923e1-46fd-4449-99f9-9037de61b811
Sep 28 18:21:33 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9609405-9657-4b69-991a-4067134cc116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a5d8927-ce1b-44b0-b7b9-5d1922139195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a5d8927-ce1b-44b0-b7b9-5d1922139195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83f522dd-390c-4158-b50e-7656c12a8d1b', 'volume_name': 'volume-83f522dd-390c-4158-b50e-7656c12a8d1b', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aa03830-727c-4f12-bbb9-c44fdb964ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aa03830-727c-4f12-bbb9-c44fdb964ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42633f7-8713-4a71-bb69-cfccf3fd691c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:33 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Volume 83f522dd-390c-4158-b50e-7656c12a8d1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83f522dd-390c-4158-b50e-7656c12a8d1b', 'volume_size': 1}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4cb91bb3-eaa2-4828-8a70-fad5d5addc56 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "cinder-05d10fa7-c949-4bfc-b6ce-5cb929676488-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4cb91bb3-eaa2-4828-8a70-fad5d5addc56 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-05d10fa7-c949-4bfc-b6ce-5cb929676488-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4cb91bb3-eaa2-4828-8a70-fad5d5addc56 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "cinder-quobyte-05d10fa7-c949-4bfc-b6ce-5cb929676488" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4cb91bb3-eaa2-4828-8a70-fad5d5addc56 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-quobyte-05d10fa7-c949-4bfc-b6ce-5cb929676488" acquired by "delete_volume" :: waited 0.028s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef79caf-a381-4477-b3dd-6e561f2be8cc]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4cb91bb3-eaa2-4828-8a70-fad5d5addc56 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:33 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8d4923e1-46fd-4449-99f9-9037de61b811" returned: 0 in 0.429s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.839s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-215324517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4dfe501-a7c4-45a6-bad6-bf85117c9add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78b7dfbffe64853ac9cf5469607ea06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:32Z,use_quota=True,user_id='b6a0cc7bc5154d759e4499f2cb43bd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Creating volume d4dfe501-a7c4-45a6-bad6-bf85117c9add {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:21:33 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d4dfe501-a7c4-45a6-bad6-bf85117c9add 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:33 devstack sudo[103061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d4dfe501-a7c4-45a6-bad6-bf85117c9add 1073741824
Sep 28 18:21:33 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7edca1b3-35a6-4114-8962-3464b736a116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d4923e1-46fd-4449-99f9-9037de61b811', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:33 devstack sudo[103060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488
Sep 28 18:21:33 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a1d35a-6142-4fa0-b20e-1c6f5a6c7438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:34 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Volume volume-8d4923e1-46fd-4449-99f9-9037de61b811 (8d4923e1-46fd-4449-99f9-9037de61b811): created successfully
Sep 28 18:21:34 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a1d35a-6142-4fa0-b20e-1c6f5a6c7438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:34 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Flow 'volume_create_manager' (56412761-9b7d-4b8d-ba4e-f6e124e6c6eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:34 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d3fc1bbe-deca-43f4-85b8-ca342db70155 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Created volume successfully.
Sep 28 18:21:34 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4cb91bb3-eaa2-4828-8a70-fad5d5addc56 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488" returned: 0 in 0.556s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4cb91bb3-eaa2-4828-8a70-fad5d5addc56 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:34 devstack sudo[103070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488
Sep 28 18:21:34 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:34 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d4dfe501-a7c4-45a6-bad6-bf85117c9add 1073741824" returned: 0 in 0.757s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d4dfe501-a7c4-45a6-bad6-bf85117c9add {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:34 devstack sudo[103074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d4dfe501-a7c4-45a6-bad6-bf85117c9add
Sep 28 18:21:34 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:34 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4cb91bb3-eaa2-4828-8a70-fad5d5addc56 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-05d10fa7-c949-4bfc-b6ce-5cb929676488" returned: 0 in 0.398s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:34 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4cb91bb3-eaa2-4828-8a70-fad5d5addc56 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-quobyte-05d10fa7-c949-4bfc-b6ce-5cb929676488" released by "delete_volume" :: held 1.078s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:34 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-4cb91bb3-eaa2-4828-8a70-fad5d5addc56 tempest-CreateVolumesFromSnapshotTest-522091956 None] Created reservations ['16c17234-d3bd-4cec-a101-60d168aebd2b', '5ea7a4af-625d-40f9-8399-b2a8dbf96c44', 'b52d220b-0945-4f8d-8f52-b629dc50f086', 'dffe4304-46e8-4883-80d7-ba5e4ed95cad'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-4cb91bb3-eaa2-4828-8a70-fad5d5addc56 tempest-CreateVolumesFromSnapshotTest-522091956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-4cb91bb3-eaa2-4828-8a70-fad5d5addc56 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-4cb91bb3-eaa2-4828-8a70-fad5d5addc56 tempest-CreateVolumesFromSnapshotTest-522091956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-4cb91bb3-eaa2-4828-8a70-fad5d5addc56 tempest-CreateVolumesFromSnapshotTest-522091956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-4cb91bb3-eaa2-4828-8a70-fad5d5addc56 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4cb91bb3-eaa2-4828-8a70-fad5d5addc56 tempest-CreateVolumesFromSnapshotTest-522091956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:35 devstack sudo[103076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:21:35 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:35 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d4dfe501-a7c4-45a6-bad6-bf85117c9add" returned: 0 in 0.396s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.502s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-670592614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99477fad-d735-4884-abda-734e7b0ed8dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78b7dfbffe64853ac9cf5469607ea06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:32Z,use_quota=True,user_id='b6a0cc7bc5154d759e4499f2cb43bd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Creating volume 99477fad-d735-4884-abda-734e7b0ed8dd {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:21:35 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-99477fad-d735-4884-abda-734e7b0ed8dd 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f56cac0-c060-470e-9fd2-d672ba3b9b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4dfe501-a7c4-45a6-bad6-bf85117c9add', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640c1c69-b2a4-43f0-a7c1-24348ad9a4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:35 devstack sudo[103079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-99477fad-d735-4884-abda-734e7b0ed8dd 1073741824
Sep 28 18:21:35 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:35 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Volume volume-d4dfe501-a7c4-45a6-bad6-bf85117c9add (d4dfe501-a7c4-45a6-bad6-bf85117c9add): created successfully
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640c1c69-b2a4-43f0-a7c1-24348ad9a4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Flow 'volume_create_manager' (9b8c4d32-f225-4573-a5b5-9c2ef1cd2849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:35 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-b64f685c-da63-4399-9567-08c7555f6fef tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Created volume successfully.
Sep 28 18:21:35 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4cb91bb3-eaa2-4828-8a70-fad5d5addc56 tempest-CreateVolumesFromSnapshotTest-522091956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.349s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-4cb91bb3-eaa2-4828-8a70-fad5d5addc56 tempest-CreateVolumesFromSnapshotTest-522091956 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:21:35 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-4cb91bb3-eaa2-4828-8a70-fad5d5addc56 tempest-CreateVolumesFromSnapshotTest-522091956 None] Deleted volume successfully.
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4cb91bb3-eaa2-4828-8a70-fad5d5addc56 tempest-CreateVolumesFromSnapshotTest-522091956 None] Lock "cinder-05d10fa7-c949-4bfc-b6ce-5cb929676488-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:35 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-99477fad-d735-4884-abda-734e7b0ed8dd 1073741824" returned: 0 in 0.691s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-99477fad-d735-4884-abda-734e7b0ed8dd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:35 devstack sudo[103086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-99477fad-d735-4884-abda-734e7b0ed8dd
Sep 28 18:21:35 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:36 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-99477fad-d735-4884-abda-734e7b0ed8dd" returned: 0 in 0.421s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:21:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.778s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-837816006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f522dd-390c-4158-b50e-7656c12a8d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78b7dfbffe64853ac9cf5469607ea06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:33Z,use_quota=True,user_id='b6a0cc7bc5154d759e4499f2cb43bd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:21:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Creating volume 83f522dd-390c-4158-b50e-7656c12a8d1b {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:21:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:21:36 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:21:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-83f522dd-390c-4158-b50e-7656c12a8d1b 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:36 devstack sudo[103089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-83f522dd-390c-4158-b50e-7656c12a8d1b 1073741824
Sep 28 18:21:36 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e39321-e59d-4ec2-8056-cd9fb1cf56b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99477fad-d735-4884-abda-734e7b0ed8dd', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9614bf-90aa-4bfd-b581-c73c1cda5c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:36 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Volume volume-99477fad-d735-4884-abda-734e7b0ed8dd (99477fad-d735-4884-abda-734e7b0ed8dd): created successfully
Sep 28 18:21:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9614bf-90aa-4bfd-b581-c73c1cda5c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Flow 'volume_create_manager' (1e849b9c-8037-4ce8-8a27-3285b6309625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:36 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d1e9bb5a-3669-4c25-babf-790ba68546e0 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Created volume successfully.
Sep 28 18:21:37 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-83f522dd-390c-4158-b50e-7656c12a8d1b 1073741824" returned: 0 in 0.821s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-83f522dd-390c-4158-b50e-7656c12a8d1b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:37 devstack sudo[103095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-83f522dd-390c-4158-b50e-7656c12a8d1b
Sep 28 18:21:37 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:37 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-83f522dd-390c-4158-b50e-7656c12a8d1b" returned: 0 in 0.382s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:21:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42633f7-8713-4a71-bb69-cfccf3fd691c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83f522dd-390c-4158-b50e-7656c12a8d1b', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9c61f6-d3c5-4cd5-83d8-6e8677e73c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:37 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Volume volume-83f522dd-390c-4158-b50e-7656c12a8d1b (83f522dd-390c-4158-b50e-7656c12a8d1b): created successfully
Sep 28 18:21:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9c61f6-d3c5-4cd5-83d8-6e8677e73c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Flow 'volume_create_manager' (9f962b0e-7595-439d-aa95-c91f6e5452b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:37 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-8d050daf-7a70-439b-b3f1-50f6f5928faf tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Created volume successfully.
Sep 28 18:21:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e51c57ef-a5ed-4ea2-bddf-a2224c33d8d8 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "cinder-83f522dd-390c-4158-b50e-7656c12a8d1b-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e51c57ef-a5ed-4ea2-bddf-a2224c33d8d8 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-83f522dd-390c-4158-b50e-7656c12a8d1b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e51c57ef-a5ed-4ea2-bddf-a2224c33d8d8 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "cinder-quobyte-83f522dd-390c-4158-b50e-7656c12a8d1b" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e51c57ef-a5ed-4ea2-bddf-a2224c33d8d8 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-quobyte-83f522dd-390c-4158-b50e-7656c12a8d1b" acquired by "delete_volume" :: waited 0.019s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:38 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[959c1cc7-ae56-41a1-852d-c6bd223f18e8]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e51c57ef-a5ed-4ea2-bddf-a2224c33d8d8 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-83f522dd-390c-4158-b50e-7656c12a8d1b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:38 devstack sudo[103098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-83f522dd-390c-4158-b50e-7656c12a8d1b
Sep 28 18:21:38 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:38 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e51c57ef-a5ed-4ea2-bddf-a2224c33d8d8 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-83f522dd-390c-4158-b50e-7656c12a8d1b" returned: 0 in 0.547s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e51c57ef-a5ed-4ea2-bddf-a2224c33d8d8 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-83f522dd-390c-4158-b50e-7656c12a8d1b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:38 devstack sudo[103103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-83f522dd-390c-4158-b50e-7656c12a8d1b
Sep 28 18:21:38 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:39 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e51c57ef-a5ed-4ea2-bddf-a2224c33d8d8 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-83f522dd-390c-4158-b50e-7656c12a8d1b" returned: 0 in 0.326s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e51c57ef-a5ed-4ea2-bddf-a2224c33d8d8 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-quobyte-83f522dd-390c-4158-b50e-7656c12a8d1b" released by "delete_volume" :: held 0.945s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-e51c57ef-a5ed-4ea2-bddf-a2224c33d8d8 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Created reservations ['871ddd15-d379-4329-9065-6ea3c92c3a6d', '2a0d9212-45ed-4372-a126-3f94381da910', 'dfe849a9-0f9e-493d-8e95-a3c932bc231f', '3d87fb07-c747-4619-af9f-7b43577f565a'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e51c57ef-a5ed-4ea2-bddf-a2224c33d8d8 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e51c57ef-a5ed-4ea2-bddf-a2224c33d8d8 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e51c57ef-a5ed-4ea2-bddf-a2224c33d8d8 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e51c57ef-a5ed-4ea2-bddf-a2224c33d8d8 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e51c57ef-a5ed-4ea2-bddf-a2224c33d8d8 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e51c57ef-a5ed-4ea2-bddf-a2224c33d8d8 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:39 devstack sudo[103106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:21:39 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:39 devstack sudo[103108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:21:39 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:39 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e51c57ef-a5ed-4ea2-bddf-a2224c33d8d8 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.348s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-e51c57ef-a5ed-4ea2-bddf-a2224c33d8d8 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:21:39 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-e51c57ef-a5ed-4ea2-bddf-a2224c33d8d8 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Deleted volume successfully.
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e51c57ef-a5ed-4ea2-bddf-a2224c33d8d8 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-83f522dd-390c-4158-b50e-7656c12a8d1b-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:39 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.439s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:21:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:21:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-280dd86b-96be-4069-bd69-82b7f3be6c63 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "cinder-99477fad-d735-4884-abda-734e7b0ed8dd-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-280dd86b-96be-4069-bd69-82b7f3be6c63 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-99477fad-d735-4884-abda-734e7b0ed8dd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-280dd86b-96be-4069-bd69-82b7f3be6c63 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "cinder-quobyte-99477fad-d735-4884-abda-734e7b0ed8dd" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-280dd86b-96be-4069-bd69-82b7f3be6c63 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-quobyte-99477fad-d735-4884-abda-734e7b0ed8dd" acquired by "delete_volume" :: waited 0.017s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:40 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a03ef3-345c-400f-b851-26c4b9f8bfef]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-280dd86b-96be-4069-bd69-82b7f3be6c63 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-99477fad-d735-4884-abda-734e7b0ed8dd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:40 devstack sudo[103112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-99477fad-d735-4884-abda-734e7b0ed8dd
Sep 28 18:21:40 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:41 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-280dd86b-96be-4069-bd69-82b7f3be6c63 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-99477fad-d735-4884-abda-734e7b0ed8dd" returned: 0 in 0.491s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-280dd86b-96be-4069-bd69-82b7f3be6c63 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-99477fad-d735-4884-abda-734e7b0ed8dd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:41 devstack sudo[103118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-99477fad-d735-4884-abda-734e7b0ed8dd
Sep 28 18:21:41 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:41 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-280dd86b-96be-4069-bd69-82b7f3be6c63 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-99477fad-d735-4884-abda-734e7b0ed8dd" returned: 0 in 0.423s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-280dd86b-96be-4069-bd69-82b7f3be6c63 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-quobyte-99477fad-d735-4884-abda-734e7b0ed8dd" released by "delete_volume" :: held 0.994s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-280dd86b-96be-4069-bd69-82b7f3be6c63 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Created reservations ['b0a54ae2-4920-4210-b3bb-99ce96d203d7', '6104aaa7-c102-40be-8210-963304eb6a03', '4106ddd3-5596-458b-a677-a4cc207c5b19', '68f75c5e-f315-4835-b891-ff700f796a75'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-280dd86b-96be-4069-bd69-82b7f3be6c63 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-280dd86b-96be-4069-bd69-82b7f3be6c63 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-280dd86b-96be-4069-bd69-82b7f3be6c63 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-280dd86b-96be-4069-bd69-82b7f3be6c63 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-280dd86b-96be-4069-bd69-82b7f3be6c63 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-280dd86b-96be-4069-bd69-82b7f3be6c63 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:41 devstack sudo[103121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:21:41 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Flow 'volume_create_manager' (068d6b8f-949c-45b3-b074-87e30b0101e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7626b4-dae3-46fc-8eed-663ea2a309d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7626b4-dae3-46fc-8eed-663ea2a309d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148482584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ebdfcb6-e056-4ac2-8bb6-1d96708afe80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae54e038dbb74975998c130da49b07c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:42Z,use_quota=True,user_id='de828d8dd24445a69051c67e431d80ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cadb202e-9d92-4a4b-bae8-7272571929de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cadb202e-9d92-4a4b-bae8-7272571929de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b7a35c-69a3-44cd-9fea-6715dd38ce38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b7a35c-69a3-44cd-9fea-6715dd38ce38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ebdfcb6-e056-4ac2-8bb6-1d96708afe80', 'volume_name': 'volume-8ebdfcb6-e056-4ac2-8bb6-1d96708afe80', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85fe4b0a-aa5a-4ea2-bb17-361c060ffb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85fe4b0a-aa5a-4ea2-bb17-361c060ffb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ceb34c-2671-43c2-9299-cadd4f67a188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:41 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Volume 8ebdfcb6-e056-4ac2-8bb6-1d96708afe80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ebdfcb6-e056-4ac2-8bb6-1d96708afe80', 'volume_size': 1}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148482584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ebdfcb6-e056-4ac2-8bb6-1d96708afe80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae54e038dbb74975998c130da49b07c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:42Z,use_quota=True,user_id='de828d8dd24445a69051c67e431d80ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Creating volume 8ebdfcb6-e056-4ac2-8bb6-1d96708afe80 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:21:41 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:21:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8ebdfcb6-e056-4ac2-8bb6-1d96708afe80 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:41 devstack sudo[103123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8ebdfcb6-e056-4ac2-8bb6-1d96708afe80 1073741824
Sep 28 18:21:41 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:42 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-280dd86b-96be-4069-bd69-82b7f3be6c63 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.353s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:42 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-280dd86b-96be-4069-bd69-82b7f3be6c63 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:21:42 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-280dd86b-96be-4069-bd69-82b7f3be6c63 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Deleted volume successfully.
Sep 28 18:21:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-280dd86b-96be-4069-bd69-82b7f3be6c63 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-99477fad-d735-4884-abda-734e7b0ed8dd-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:42 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8ebdfcb6-e056-4ac2-8bb6-1d96708afe80 1073741824" returned: 0 in 0.525s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8ebdfcb6-e056-4ac2-8bb6-1d96708afe80 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:42 devstack sudo[103130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8ebdfcb6-e056-4ac2-8bb6-1d96708afe80
Sep 28 18:21:42 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-76329193-3cda-424d-8621-605bfb39401d tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "cinder-d4dfe501-a7c4-45a6-bad6-bf85117c9add-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-76329193-3cda-424d-8621-605bfb39401d tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-d4dfe501-a7c4-45a6-bad6-bf85117c9add-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-76329193-3cda-424d-8621-605bfb39401d tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "cinder-quobyte-d4dfe501-a7c4-45a6-bad6-bf85117c9add" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-76329193-3cda-424d-8621-605bfb39401d tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-quobyte-d4dfe501-a7c4-45a6-bad6-bf85117c9add" acquired by "delete_volume" :: waited 0.016s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:42 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8ebdfcb6-e056-4ac2-8bb6-1d96708afe80" returned: 0 in 0.354s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:21:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ceb34c-2671-43c2-9299-cadd4f67a188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ebdfcb6-e056-4ac2-8bb6-1d96708afe80', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5643525c-4b23-4e57-90aa-ecff930910ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:42 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bbefa3-682b-44ac-89cf-fe4918b3ba1e]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-76329193-3cda-424d-8621-605bfb39401d tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d4dfe501-a7c4-45a6-bad6-bf85117c9add {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:42 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Volume volume-8ebdfcb6-e056-4ac2-8bb6-1d96708afe80 (8ebdfcb6-e056-4ac2-8bb6-1d96708afe80): created successfully
Sep 28 18:21:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5643525c-4b23-4e57-90aa-ecff930910ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Flow 'volume_create_manager' (068d6b8f-949c-45b3-b074-87e30b0101e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:42 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-fdb9f334-63bb-44e3-bb42-e255ee631b7d tempest-ProjectReaderTests-1829382927 None] Created volume successfully.
Sep 28 18:21:43 devstack sudo[103133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d4dfe501-a7c4-45a6-bad6-bf85117c9add
Sep 28 18:21:43 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:43 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-76329193-3cda-424d-8621-605bfb39401d tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d4dfe501-a7c4-45a6-bad6-bf85117c9add" returned: 0 in 0.436s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-76329193-3cda-424d-8621-605bfb39401d tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d4dfe501-a7c4-45a6-bad6-bf85117c9add {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:43 devstack sudo[103139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d4dfe501-a7c4-45a6-bad6-bf85117c9add
Sep 28 18:21:43 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:43 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-76329193-3cda-424d-8621-605bfb39401d tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d4dfe501-a7c4-45a6-bad6-bf85117c9add" returned: 0 in 0.285s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-76329193-3cda-424d-8621-605bfb39401d tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-quobyte-d4dfe501-a7c4-45a6-bad6-bf85117c9add" released by "delete_volume" :: held 0.787s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:43 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-76329193-3cda-424d-8621-605bfb39401d tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Created reservations ['05ab2628-07b6-46fa-a2a6-9fefa2ac8d59', '7de86139-2a47-4138-adac-8f1a5c14ddd3', '6ece9e0c-d546-4ac9-8313-328c20d13a6f', '4e277341-38cc-4b5f-9409-34e89c1675ad'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:21:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-76329193-3cda-424d-8621-605bfb39401d tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-76329193-3cda-424d-8621-605bfb39401d tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-76329193-3cda-424d-8621-605bfb39401d tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-76329193-3cda-424d-8621-605bfb39401d tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-76329193-3cda-424d-8621-605bfb39401d tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-76329193-3cda-424d-8621-605bfb39401d tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:43 devstack sudo[103142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:21:43 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a3d39476-6df9-4d62-84e6-8c61a0c1469b tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "cinder-8d4923e1-46fd-4449-99f9-9037de61b811-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a3d39476-6df9-4d62-84e6-8c61a0c1469b tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-8d4923e1-46fd-4449-99f9-9037de61b811-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a3d39476-6df9-4d62-84e6-8c61a0c1469b tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "cinder-quobyte-8d4923e1-46fd-4449-99f9-9037de61b811" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a3d39476-6df9-4d62-84e6-8c61a0c1469b tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-quobyte-8d4923e1-46fd-4449-99f9-9037de61b811" acquired by "delete_volume" :: waited 0.025s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:44 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[65912fd9-6921-4096-8f40-03d6573b40ae]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a3d39476-6df9-4d62-84e6-8c61a0c1469b tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8d4923e1-46fd-4449-99f9-9037de61b811 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5bc0dfdf-d82e-40ac-886d-b39c84121c81 tempest-ProjectReaderTests-1829382927 None] Acquiring lock "cinder-8ebdfcb6-e056-4ac2-8bb6-1d96708afe80-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5bc0dfdf-d82e-40ac-886d-b39c84121c81 tempest-ProjectReaderTests-1829382927 None] Lock "cinder-8ebdfcb6-e056-4ac2-8bb6-1d96708afe80-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:44 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-76329193-3cda-424d-8621-605bfb39401d tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.404s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:44 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-76329193-3cda-424d-8621-605bfb39401d tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:21:44 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-76329193-3cda-424d-8621-605bfb39401d tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Deleted volume successfully.
Sep 28 18:21:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5bc0dfdf-d82e-40ac-886d-b39c84121c81 tempest-ProjectReaderTests-1829382927 None] Acquiring lock "cinder-quobyte-8ebdfcb6-e056-4ac2-8bb6-1d96708afe80" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5bc0dfdf-d82e-40ac-886d-b39c84121c81 tempest-ProjectReaderTests-1829382927 None] Lock "cinder-quobyte-8ebdfcb6-e056-4ac2-8bb6-1d96708afe80" acquired by "delete_volume" :: waited 0.042s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-76329193-3cda-424d-8621-605bfb39401d tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-d4dfe501-a7c4-45a6-bad6-bf85117c9add-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:44 devstack sudo[103145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8d4923e1-46fd-4449-99f9-9037de61b811
Sep 28 18:21:44 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:44 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d9bed6-2110-40a5-8b6e-62492ce11dea]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5bc0dfdf-d82e-40ac-886d-b39c84121c81 tempest-ProjectReaderTests-1829382927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8ebdfcb6-e056-4ac2-8bb6-1d96708afe80 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:44 devstack sudo[103147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8ebdfcb6-e056-4ac2-8bb6-1d96708afe80
Sep 28 18:21:44 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:44 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a3d39476-6df9-4d62-84e6-8c61a0c1469b tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8d4923e1-46fd-4449-99f9-9037de61b811" returned: 0 in 0.536s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a3d39476-6df9-4d62-84e6-8c61a0c1469b tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8d4923e1-46fd-4449-99f9-9037de61b811 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:44 devstack sudo[103152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8d4923e1-46fd-4449-99f9-9037de61b811
Sep 28 18:21:44 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:45 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5bc0dfdf-d82e-40ac-886d-b39c84121c81 tempest-ProjectReaderTests-1829382927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8ebdfcb6-e056-4ac2-8bb6-1d96708afe80" returned: 0 in 0.661s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5bc0dfdf-d82e-40ac-886d-b39c84121c81 tempest-ProjectReaderTests-1829382927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8ebdfcb6-e056-4ac2-8bb6-1d96708afe80 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:45 devstack sudo[103158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8ebdfcb6-e056-4ac2-8bb6-1d96708afe80
Sep 28 18:21:45 devstack sudo[103158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:45 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a3d39476-6df9-4d62-84e6-8c61a0c1469b tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8d4923e1-46fd-4449-99f9-9037de61b811" returned: 0 in 0.435s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a3d39476-6df9-4d62-84e6-8c61a0c1469b tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-quobyte-8d4923e1-46fd-4449-99f9-9037de61b811" released by "delete_volume" :: held 1.040s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-a3d39476-6df9-4d62-84e6-8c61a0c1469b tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Created reservations ['556e5873-a2c8-4346-9a8d-25e066a783f5', 'd6ec6ee3-4cb3-497b-9ec7-7db2063e4cb3', '4e38cddd-88c8-44eb-86ae-ba3695d38b47', '086e0aaa-3e6f-481c-83d0-e43a298ecdc4'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a3d39476-6df9-4d62-84e6-8c61a0c1469b tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a3d39476-6df9-4d62-84e6-8c61a0c1469b tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a3d39476-6df9-4d62-84e6-8c61a0c1469b tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a3d39476-6df9-4d62-84e6-8c61a0c1469b tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a3d39476-6df9-4d62-84e6-8c61a0c1469b tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a3d39476-6df9-4d62-84e6-8c61a0c1469b tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:45 devstack sudo[103162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:21:45 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:45 devstack sudo[103158]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5bc0dfdf-d82e-40ac-886d-b39c84121c81 tempest-ProjectReaderTests-1829382927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8ebdfcb6-e056-4ac2-8bb6-1d96708afe80" returned: 0 in 0.367s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5bc0dfdf-d82e-40ac-886d-b39c84121c81 tempest-ProjectReaderTests-1829382927 None] Lock "cinder-quobyte-8ebdfcb6-e056-4ac2-8bb6-1d96708afe80" released by "delete_volume" :: held 1.087s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-5bc0dfdf-d82e-40ac-886d-b39c84121c81 tempest-ProjectReaderTests-1829382927 None] Created reservations ['8e765706-50b3-4bee-9af0-0ae627e6e1ec', 'c120938b-d6a2-4fea-8c77-cc560962811a', 'dcecdcef-43e1-47e4-bd1f-4708ed3b8748', '855408fc-377c-4912-9eed-9a8f85222457'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5bc0dfdf-d82e-40ac-886d-b39c84121c81 tempest-ProjectReaderTests-1829382927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5bc0dfdf-d82e-40ac-886d-b39c84121c81 tempest-ProjectReaderTests-1829382927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5bc0dfdf-d82e-40ac-886d-b39c84121c81 tempest-ProjectReaderTests-1829382927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5bc0dfdf-d82e-40ac-886d-b39c84121c81 tempest-ProjectReaderTests-1829382927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5bc0dfdf-d82e-40ac-886d-b39c84121c81 tempest-ProjectReaderTests-1829382927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5bc0dfdf-d82e-40ac-886d-b39c84121c81 tempest-ProjectReaderTests-1829382927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:45 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a3d39476-6df9-4d62-84e6-8c61a0c1469b tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.279s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-a3d39476-6df9-4d62-84e6-8c61a0c1469b tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:21:45 devstack sudo[103165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:21:45 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:45 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-a3d39476-6df9-4d62-84e6-8c61a0c1469b tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Deleted volume successfully.
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a3d39476-6df9-4d62-84e6-8c61a0c1469b tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-8d4923e1-46fd-4449-99f9-9037de61b811-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:45 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5bc0dfdf-d82e-40ac-886d-b39c84121c81 tempest-ProjectReaderTests-1829382927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.320s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-5bc0dfdf-d82e-40ac-886d-b39c84121c81 tempest-ProjectReaderTests-1829382927 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:21:45 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-5bc0dfdf-d82e-40ac-886d-b39c84121c81 tempest-ProjectReaderTests-1829382927 None] Deleted volume successfully.
Sep 28 18:21:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5bc0dfdf-d82e-40ac-886d-b39c84121c81 tempest-ProjectReaderTests-1829382927 None] Lock "cinder-8ebdfcb6-e056-4ac2-8bb6-1d96708afe80-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f55bd74b-cfde-4250-b66e-6e5d66f46c82 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "cinder-a01d3b52-c549-47be-861f-5c7111a1a7ee-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f55bd74b-cfde-4250-b66e-6e5d66f46c82 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-a01d3b52-c549-47be-861f-5c7111a1a7ee-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f55bd74b-cfde-4250-b66e-6e5d66f46c82 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "cinder-quobyte-a01d3b52-c549-47be-861f-5c7111a1a7ee" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f55bd74b-cfde-4250-b66e-6e5d66f46c82 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-quobyte-a01d3b52-c549-47be-861f-5c7111a1a7ee" acquired by "delete_volume" :: waited 0.023s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:46 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64e4c50-0a2f-40a9-8ef8-9b5373f72f9d]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f55bd74b-cfde-4250-b66e-6e5d66f46c82 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a01d3b52-c549-47be-861f-5c7111a1a7ee {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:46 devstack sudo[103168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a01d3b52-c549-47be-861f-5c7111a1a7ee
Sep 28 18:21:46 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:47 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f55bd74b-cfde-4250-b66e-6e5d66f46c82 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a01d3b52-c549-47be-861f-5c7111a1a7ee" returned: 0 in 0.552s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f55bd74b-cfde-4250-b66e-6e5d66f46c82 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a01d3b52-c549-47be-861f-5c7111a1a7ee {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:47 devstack sudo[103173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a01d3b52-c549-47be-861f-5c7111a1a7ee
Sep 28 18:21:47 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Flow 'volume_create_manager' (3cfed30f-ded6-4ec9-9fc3-94b14cce5dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a0478e4-3594-4f7f-9424-c1b4515dd246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a0478e4-3594-4f7f-9424-c1b4515dd246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1356820530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc5b717-c445-40b7-a5c5-eea23bf20a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae54e038dbb74975998c130da49b07c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:47Z,use_quota=True,user_id='de828d8dd24445a69051c67e431d80ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f1f14a-3286-4caf-bdf6-dcad913ee001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f1f14a-3286-4caf-bdf6-dcad913ee001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc97eb9-3eda-47ad-b9b6-d58fcbdb13ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc97eb9-3eda-47ad-b9b6-d58fcbdb13ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fc5b717-c445-40b7-a5c5-eea23bf20a19', 'volume_name': 'volume-2fc5b717-c445-40b7-a5c5-eea23bf20a19', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf80245-e876-429c-8afb-ec74802ccffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf80245-e876-429c-8afb-ec74802ccffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdeb577d-7b1d-416c-8bf7-4a9bc4b87f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:47 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Volume 2fc5b717-c445-40b7-a5c5-eea23bf20a19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fc5b717-c445-40b7-a5c5-eea23bf20a19', 'volume_size': 1}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1356820530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc5b717-c445-40b7-a5c5-eea23bf20a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae54e038dbb74975998c130da49b07c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:47Z,use_quota=True,user_id='de828d8dd24445a69051c67e431d80ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Creating volume 2fc5b717-c445-40b7-a5c5-eea23bf20a19 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:21:47 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fc5b717-c445-40b7-a5c5-eea23bf20a19 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:47 devstack sudo[103175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fc5b717-c445-40b7-a5c5-eea23bf20a19 1073741824
Sep 28 18:21:47 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:47 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f55bd74b-cfde-4250-b66e-6e5d66f46c82 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a01d3b52-c549-47be-861f-5c7111a1a7ee" returned: 0 in 0.329s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f55bd74b-cfde-4250-b66e-6e5d66f46c82 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-quobyte-a01d3b52-c549-47be-861f-5c7111a1a7ee" released by "delete_volume" :: held 0.946s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-f55bd74b-cfde-4250-b66e-6e5d66f46c82 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Created reservations ['bf291824-ee8c-41dc-8f54-30838231cf50', '86b835b2-dd8a-4098-899b-732acd47a641', '0f92a1c9-9301-4015-8f85-52021758cb13', 'a04bb10f-0ccb-4c54-9c4d-7e827824b381'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f55bd74b-cfde-4250-b66e-6e5d66f46c82 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f55bd74b-cfde-4250-b66e-6e5d66f46c82 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f55bd74b-cfde-4250-b66e-6e5d66f46c82 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f55bd74b-cfde-4250-b66e-6e5d66f46c82 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f55bd74b-cfde-4250-b66e-6e5d66f46c82 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f55bd74b-cfde-4250-b66e-6e5d66f46c82 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:47 devstack sudo[103181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:21:47 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:47 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fc5b717-c445-40b7-a5c5-eea23bf20a19 1073741824" returned: 0 in 0.678s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fc5b717-c445-40b7-a5c5-eea23bf20a19 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:48 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f55bd74b-cfde-4250-b66e-6e5d66f46c82 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.361s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:48 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-f55bd74b-cfde-4250-b66e-6e5d66f46c82 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:21:48 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-f55bd74b-cfde-4250-b66e-6e5d66f46c82 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Deleted volume successfully.
Sep 28 18:21:48 devstack sudo[103185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fc5b717-c445-40b7-a5c5-eea23bf20a19
Sep 28 18:21:48 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f55bd74b-cfde-4250-b66e-6e5d66f46c82 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-a01d3b52-c549-47be-861f-5c7111a1a7ee-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:48 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fc5b717-c445-40b7-a5c5-eea23bf20a19" returned: 0 in 0.322s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:48 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:21:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdeb577d-7b1d-416c-8bf7-4a9bc4b87f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fc5b717-c445-40b7-a5c5-eea23bf20a19', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d6ab85-4328-4429-8414-f867f35c3cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:48 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Volume volume-2fc5b717-c445-40b7-a5c5-eea23bf20a19 (2fc5b717-c445-40b7-a5c5-eea23bf20a19): created successfully
Sep 28 18:21:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d6ab85-4328-4429-8414-f867f35c3cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:48 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Flow 'volume_create_manager' (3cfed30f-ded6-4ec9-9fc3-94b14cce5dee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:48 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-6e9ee6f0-7133-4f4a-b73a-89d69a0cdd2b tempest-ProjectReaderTests-1829382927 None] Created volume successfully.
Sep 28 18:21:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9d475625-341d-48a1-bcad-b9bc5eeb9b05 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "cinder-888a0bb8-ef54-4156-8715-c4d8b9f80f09-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9d475625-341d-48a1-bcad-b9bc5eeb9b05 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-888a0bb8-ef54-4156-8715-c4d8b9f80f09-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9d475625-341d-48a1-bcad-b9bc5eeb9b05 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "cinder-quobyte-888a0bb8-ef54-4156-8715-c4d8b9f80f09" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9d475625-341d-48a1-bcad-b9bc5eeb9b05 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-quobyte-888a0bb8-ef54-4156-8715-c4d8b9f80f09" acquired by "delete_volume" :: waited 0.034s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:48 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc9d29a-7ebc-44da-87c1-390ac32ff44b]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d475625-341d-48a1-bcad-b9bc5eeb9b05 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-888a0bb8-ef54-4156-8715-c4d8b9f80f09 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:49 devstack sudo[103188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-888a0bb8-ef54-4156-8715-c4d8b9f80f09
Sep 28 18:21:49 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5ce99158-29f6-4406-823b-c5e9ab502034 tempest-ProjectReaderTests-1829382927 None] Acquiring lock "cinder-2fc5b717-c445-40b7-a5c5-eea23bf20a19-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:49 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d475625-341d-48a1-bcad-b9bc5eeb9b05 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-888a0bb8-ef54-4156-8715-c4d8b9f80f09" returned: 0 in 0.515s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d475625-341d-48a1-bcad-b9bc5eeb9b05 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-888a0bb8-ef54-4156-8715-c4d8b9f80f09 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5ce99158-29f6-4406-823b-c5e9ab502034 tempest-ProjectReaderTests-1829382927 None] Lock "cinder-2fc5b717-c445-40b7-a5c5-eea23bf20a19-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:49 devstack sudo[103194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-888a0bb8-ef54-4156-8715-c4d8b9f80f09
Sep 28 18:21:49 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5ce99158-29f6-4406-823b-c5e9ab502034 tempest-ProjectReaderTests-1829382927 None] Acquiring lock "cinder-quobyte-2fc5b717-c445-40b7-a5c5-eea23bf20a19" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:21:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5ce99158-29f6-4406-823b-c5e9ab502034 tempest-ProjectReaderTests-1829382927 None] Lock "cinder-quobyte-2fc5b717-c445-40b7-a5c5-eea23bf20a19" acquired by "delete_volume" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:21:49 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[119a89dd-4ebb-4668-bff4-5f15ce50979c]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5ce99158-29f6-4406-823b-c5e9ab502034 tempest-ProjectReaderTests-1829382927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fc5b717-c445-40b7-a5c5-eea23bf20a19 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:49 devstack sudo[103196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fc5b717-c445-40b7-a5c5-eea23bf20a19
Sep 28 18:21:49 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:49 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d475625-341d-48a1-bcad-b9bc5eeb9b05 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-888a0bb8-ef54-4156-8715-c4d8b9f80f09" returned: 0 in 0.369s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9d475625-341d-48a1-bcad-b9bc5eeb9b05 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-quobyte-888a0bb8-ef54-4156-8715-c4d8b9f80f09" released by "delete_volume" :: held 0.944s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:49 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-9d475625-341d-48a1-bcad-b9bc5eeb9b05 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Created reservations ['be846c22-ccc6-45d3-905c-74d464b4f212', '4672cb97-b3b1-411d-83b5-d5f022281a72', '0f9bdb15-53ae-4b31-a7cf-30331cb1ac28', '09c3e894-aca5-43c4-84d7-83f992306b84'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:21:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9d475625-341d-48a1-bcad-b9bc5eeb9b05 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9d475625-341d-48a1-bcad-b9bc5eeb9b05 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9d475625-341d-48a1-bcad-b9bc5eeb9b05 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9d475625-341d-48a1-bcad-b9bc5eeb9b05 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9d475625-341d-48a1-bcad-b9bc5eeb9b05 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d475625-341d-48a1-bcad-b9bc5eeb9b05 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:50 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5ce99158-29f6-4406-823b-c5e9ab502034 tempest-ProjectReaderTests-1829382927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fc5b717-c445-40b7-a5c5-eea23bf20a19" returned: 0 in 0.507s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5ce99158-29f6-4406-823b-c5e9ab502034 tempest-ProjectReaderTests-1829382927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fc5b717-c445-40b7-a5c5-eea23bf20a19 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:50 devstack sudo[103202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:21:50 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:50 devstack sudo[103203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fc5b717-c445-40b7-a5c5-eea23bf20a19
Sep 28 18:21:50 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:50 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d475625-341d-48a1-bcad-b9bc5eeb9b05 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.320s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:50 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-9d475625-341d-48a1-bcad-b9bc5eeb9b05 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:21:50 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-9d475625-341d-48a1-bcad-b9bc5eeb9b05 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Deleted volume successfully.
Sep 28 18:21:50 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9d475625-341d-48a1-bcad-b9bc5eeb9b05 tempest-CreateVolumesFromSourceVolumeTest-763632931 None] Lock "cinder-888a0bb8-ef54-4156-8715-c4d8b9f80f09-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:50 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5ce99158-29f6-4406-823b-c5e9ab502034 tempest-ProjectReaderTests-1829382927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2fc5b717-c445-40b7-a5c5-eea23bf20a19" returned: 0 in 0.361s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:50 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5ce99158-29f6-4406-823b-c5e9ab502034 tempest-ProjectReaderTests-1829382927 None] Lock "cinder-quobyte-2fc5b717-c445-40b7-a5c5-eea23bf20a19" released by "delete_volume" :: held 0.939s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:50 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-5ce99158-29f6-4406-823b-c5e9ab502034 tempest-ProjectReaderTests-1829382927 None] Created reservations ['06863a3e-0de5-475c-b850-a87b86158f6c', 'aac13205-e250-4484-bf8c-5e870b3fe303', '1bb51cd5-eeaa-41d8-ab01-8f38cfe26027', 'fe6a6e41-b97e-49d5-a6c2-8a4d1994107c'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:21:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5ce99158-29f6-4406-823b-c5e9ab502034 tempest-ProjectReaderTests-1829382927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:21:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5ce99158-29f6-4406-823b-c5e9ab502034 tempest-ProjectReaderTests-1829382927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:21:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5ce99158-29f6-4406-823b-c5e9ab502034 tempest-ProjectReaderTests-1829382927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:21:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5ce99158-29f6-4406-823b-c5e9ab502034 tempest-ProjectReaderTests-1829382927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:21:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5ce99158-29f6-4406-823b-c5e9ab502034 tempest-ProjectReaderTests-1829382927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:21:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5ce99158-29f6-4406-823b-c5e9ab502034 tempest-ProjectReaderTests-1829382927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:50 devstack sudo[103208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:21:50 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:50 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5ce99158-29f6-4406-823b-c5e9ab502034 tempest-ProjectReaderTests-1829382927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.346s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:50 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-5ce99158-29f6-4406-823b-c5e9ab502034 tempest-ProjectReaderTests-1829382927 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:21:50 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-5ce99158-29f6-4406-823b-c5e9ab502034 tempest-ProjectReaderTests-1829382927 None] Deleted volume successfully.
Sep 28 18:21:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5ce99158-29f6-4406-823b-c5e9ab502034 tempest-ProjectReaderTests-1829382927 None] Lock "cinder-2fc5b717-c445-40b7-a5c5-eea23bf20a19-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:21:58 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:21:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Flow 'volume_create_manager' (1d8afbc9-c325-42f9-a0b5-3f06fc81e359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:21:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90b061f-afd3-433c-89ac-9b7e55fd20c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90b061f-afd3-433c-89ac-9b7e55fd20c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bed2340-ccca-40de-a9eb-16ed0bb1e7cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bbfb7406004e1faed029879faa3695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:58Z,use_quota=True,user_id='ea678b3e2fd540599e2a7302f2c5b1ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f138f87-1319-468c-9292-e5bdc3a7f6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f138f87-1319-468c-9292-e5bdc3a7f6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46dbf5ff-5e8f-4f39-bc7d-065066295ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:58 devstack cinder-volume[87046]: DEBUG cinder.image.glance [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Creating Keystone auth plugin from conf {{(pid=87046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 28 18:21:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46dbf5ff-5e8f-4f39-bc7d-065066295ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2bed2340-ccca-40de-a9eb-16ed0bb1e7cb', 'volume_name': 'volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb', 'volume_size': 1, 'image_id': '23143fa8-9862-4345-8b9f-89464e8f5ab4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23143fa8-9862-4345-8b9f-89464e8f5ab4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '34693925c34c91b9dc40c25878324aab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e5bbfb7406004e1faed029879faa3695', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a40d8b2e75db533102ed56c1730123af0a80ed2d1f8804a5b3f6944756341bed3c8e1267b81ecc9548b775d473cea6f1757b65f000c23a854568cac2946f30a', 'id': '23143fa8-9862-4345-8b9f-89464e8f5ab4', 'created_at': datetime.datetime(2026, 9, 28, 16, 21, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 21, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23143fa8-9862-4345-8b9f-89464e8f5ab4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aa4b09d30>}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9090379d-c37e-4317-8a3b-b8e957eb1902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9090379d-c37e-4317-8a3b-b8e957eb1902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:21:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8df893-c4ce-4b9f-bb75-9f0d246725f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:21:58 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Volume 2bed2340-ccca-40de-a9eb-16ed0bb1e7cb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb', 'volume_size': 1, 'image_id': '23143fa8-9862-4345-8b9f-89464e8f5ab4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23143fa8-9862-4345-8b9f-89464e8f5ab4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '34693925c34c91b9dc40c25878324aab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e5bbfb7406004e1faed029879faa3695', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a40d8b2e75db533102ed56c1730123af0a80ed2d1f8804a5b3f6944756341bed3c8e1267b81ecc9548b775d473cea6f1757b65f000c23a854568cac2946f30a', 'id': '23143fa8-9862-4345-8b9f-89464e8f5ab4', 'created_at': datetime.datetime(2026, 9, 28, 16, 21, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 21, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23143fa8-9862-4345-8b9f-89464e8f5ab4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aa4b09d30>}
Sep 28 18:21:58 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Trying to clone 2bed2340-ccca-40de-a9eb-16ed0bb1e7cb from image 23143fa8-9862-4345-8b9f-89464e8f5ab4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/23143fa8-9862-4345-8b9f-89464e8f5ab4', 'metadata': {}}]). {{(pid=87046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 28 18:21:59 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 28 18:21:59 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Image download 0.00 MB at 0.00 MB/s
Sep 28 18:21:59 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[461433bb-0869-454a-aafb-1bc8748bb786]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:21:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:59 devstack sudo[103215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD
Sep 28 18:21:59 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:21:59 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root
Sep 28 18:21:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD" returned: 0 in 0.530s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:21:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:21:59 devstack sudo[103219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD
Sep 28 18:21:59 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:00 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD" returned: 1 in 0.541s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:22:00 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Temporary image 23143fa8-9862-4345-8b9f-89464e8f5ab4 is fetched for user ea678b3e2fd540599e2a7302f2c5b1ae. {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 28 18:22:00 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14832fd-37fc-4511-b907-35729c30dd25]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:22:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:00 devstack sudo[103239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD
Sep 28 18:22:00 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:00 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:00 devstack sudo[103247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD
Sep 28 18:22:00 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:01 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD" returned: 1 in 0.495s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:22:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bed2340-ccca-40de-a9eb-16ed0bb1e7cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bbfb7406004e1faed029879faa3695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:58Z,use_quota=True,user_id='ea678b3e2fd540599e2a7302f2c5b1ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:22:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Creating volume 2bed2340-ccca-40de-a9eb-16ed0bb1e7cb {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:22:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:22:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:22:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:22:01 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:22:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:01 devstack sudo[103266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb 1073741824
Sep 28 18:22:01 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:01 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb 1073741824" returned: 0 in 0.589s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:01 devstack sudo[103279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb
Sep 28 18:22:01 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:02 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb" returned: 0 in 0.393s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:02 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:22:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:02 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Attempting download of 23143fa8-9862-4345-8b9f-89464e8f5ab4 ((None, [{'url': 'file:///opt/stack/data/glance/images/23143fa8-9862-4345-8b9f-89464e8f5ab4', 'metadata': {}}])) to volume 2bed2340-ccca-40de-a9eb-16ed0bb1e7cb. {{(pid=87046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 28 18:22:02 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ccde39-a605-4dae-ad6a-df1b0bc5630f]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:22:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23143fa8-9862-4345-8b9f-89464e8f5ab4_j0yw6a54 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:02 devstack sudo[103282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23143fa8-9862-4345-8b9f-89464e8f5ab4_j0yw6a54
Sep 28 18:22:02 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:02 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23143fa8-9862-4345-8b9f-89464e8f5ab4_j0yw6a54" returned: 0 in 0.385s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23143fa8-9862-4345-8b9f-89464e8f5ab4_j0yw6a54 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:02 devstack sudo[103286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23143fa8-9862-4345-8b9f-89464e8f5ab4_j0yw6a54
Sep 28 18:22:02 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:03 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23143fa8-9862-4345-8b9f-89464e8f5ab4_j0yw6a54" returned: 1 in 0.487s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23143fa8-9862-4345-8b9f-89464e8f5ab4_j0yw6a54' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:22:03 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[19023dfa-048f-4154-ba13-87e3ce2cfbb5]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:22:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:03 devstack sudo[103304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD
Sep 28 18:22:03 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:03 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD" returned: 0 in 0.716s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:04 devstack sudo[103338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD
Sep 28 18:22:04 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:04 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD" returned: 1 in 0.478s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:22:04 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] 23143fa8-9862-4345-8b9f-89464e8f5ab4 was raw, converting to qcow2 {{(pid=87046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 28 18:22:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:04 devstack sudo[103364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb
Sep 28 18:22:04 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:05 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb" returned: 0 in 0.598s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:05 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_23143fa8-9862-4345-8b9f-89464e8f5ab4_wwlhyr3pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:22:05 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Converted 0.00 MB image at 0.00 MB/s
Sep 28 18:22:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:05 devstack sudo[103387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb 1G
Sep 28 18:22:05 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:05 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb 1G" returned: 0 in 0.378s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:05 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Downloaded image 23143fa8-9862-4345-8b9f-89464e8f5ab4 ((None, [{'url': 'file:///opt/stack/data/glance/images/23143fa8-9862-4345-8b9f-89464e8f5ab4', 'metadata': {}}])) to volume 2bed2340-ccca-40de-a9eb-16ed0bb1e7cb successfully. {{(pid=87046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 28 18:22:05 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Temporary image 23143fa8-9862-4345-8b9f-89464e8f5ab4 for user ea678b3e2fd540599e2a7302f2c5b1ae is deleted. {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 28 18:22:05 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Marking volume 2bed2340-ccca-40de-a9eb-16ed0bb1e7cb as bootable. {{(pid=87046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 28 18:22:05 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Copying metadata from image 23143fa8-9862-4345-8b9f-89464e8f5ab4 to 2bed2340-ccca-40de-a9eb-16ed0bb1e7cb. {{(pid=87046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 28 18:22:05 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Creating volume glance metadata for volume 2bed2340-ccca-40de-a9eb-16ed0bb1e7cb backed by image 23143fa8-9862-4345-8b9f-89464e8f5ab4 with: {'image_id': '23143fa8-9862-4345-8b9f-89464e8f5ab4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '34693925c34c91b9dc40c25878324aab', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 28 18:22:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8df893-c4ce-4b9f-bb75-9f0d246725f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb', 'volume_size': 1, 'image_id': '23143fa8-9862-4345-8b9f-89464e8f5ab4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23143fa8-9862-4345-8b9f-89464e8f5ab4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '34693925c34c91b9dc40c25878324aab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e5bbfb7406004e1faed029879faa3695', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a40d8b2e75db533102ed56c1730123af0a80ed2d1f8804a5b3f6944756341bed3c8e1267b81ecc9548b775d473cea6f1757b65f000c23a854568cac2946f30a', 'id': '23143fa8-9862-4345-8b9f-89464e8f5ab4', 'created_at': datetime.datetime(2026, 9, 28, 16, 21, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 21, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23143fa8-9862-4345-8b9f-89464e8f5ab4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aa4b09d30>}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b26d081-6340-48b2-b02d-b876ac3b2e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:05 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Volume volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb (2bed2340-ccca-40de-a9eb-16ed0bb1e7cb): created successfully
Sep 28 18:22:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b26d081-6340-48b2-b02d-b876ac3b2e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Flow 'volume_create_manager' (1d8afbc9-c325-42f9-a0b5-3f06fc81e359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:22:05 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-e8c52958-6822-4eb8-ac4d-775f85307191 tempest-VolumeImageDependencyTests-18726402 None] Created volume successfully.
Sep 28 18:22:06 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ccbd4399-ccb4-42db-b73d-be49a686c35d tempest-VolumeImageDependencyTests-18726402 None] Acquiring lock "cinder-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:22:06 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ccbd4399-ccb4-42db-b73d-be49a686c35d tempest-VolumeImageDependencyTests-18726402 None] Lock "cinder-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:22:06 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ccbd4399-ccb4-42db-b73d-be49a686c35d tempest-VolumeImageDependencyTests-18726402 None] Acquiring lock "cinder-quobyte-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:22:06 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ccbd4399-ccb4-42db-b73d-be49a686c35d tempest-VolumeImageDependencyTests-18726402 None] Lock "cinder-quobyte-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb" acquired by "delete_volume" :: waited 0.021s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:22:06 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3220900-9c09-4fe5-81b2-13b3cbc385d2]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:22:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ccbd4399-ccb4-42db-b73d-be49a686c35d tempest-VolumeImageDependencyTests-18726402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:06 devstack sudo[103395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb
Sep 28 18:22:06 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:06 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ccbd4399-ccb4-42db-b73d-be49a686c35d tempest-VolumeImageDependencyTests-18726402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb" returned: 0 in 0.492s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ccbd4399-ccb4-42db-b73d-be49a686c35d tempest-VolumeImageDependencyTests-18726402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:06 devstack sudo[103400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb
Sep 28 18:22:06 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:07 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ccbd4399-ccb4-42db-b73d-be49a686c35d tempest-VolumeImageDependencyTests-18726402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb" returned: 0 in 0.336s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ccbd4399-ccb4-42db-b73d-be49a686c35d tempest-VolumeImageDependencyTests-18726402 None] Lock "cinder-quobyte-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb" released by "delete_volume" :: held 0.910s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:22:07 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-ccbd4399-ccb4-42db-b73d-be49a686c35d tempest-VolumeImageDependencyTests-18726402 None] Created reservations ['758593ed-14cb-443f-8497-025f44a41aba', '235eeb71-0834-4254-9cf2-47aaefd2b30c', '2621b428-b5b3-412c-93a8-533c54adc7c0', 'a9a6e736-b495-47e6-87af-3b3291aefa72'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:22:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ccbd4399-ccb4-42db-b73d-be49a686c35d tempest-VolumeImageDependencyTests-18726402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ccbd4399-ccb4-42db-b73d-be49a686c35d tempest-VolumeImageDependencyTests-18726402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:07 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ccbd4399-ccb4-42db-b73d-be49a686c35d tempest-VolumeImageDependencyTests-18726402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:22:07 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ccbd4399-ccb4-42db-b73d-be49a686c35d tempest-VolumeImageDependencyTests-18726402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:22:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ccbd4399-ccb4-42db-b73d-be49a686c35d tempest-VolumeImageDependencyTests-18726402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ccbd4399-ccb4-42db-b73d-be49a686c35d tempest-VolumeImageDependencyTests-18726402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:07 devstack sudo[103403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:22:07 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:07 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ccbd4399-ccb4-42db-b73d-be49a686c35d tempest-VolumeImageDependencyTests-18726402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.478s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:07 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-ccbd4399-ccb4-42db-b73d-be49a686c35d tempest-VolumeImageDependencyTests-18726402 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:22:07 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-ccbd4399-ccb4-42db-b73d-be49a686c35d tempest-VolumeImageDependencyTests-18726402 None] Deleted volume successfully.
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ccbd4399-ccb4-42db-b73d-be49a686c35d tempest-VolumeImageDependencyTests-18726402 None] Lock "cinder-2bed2340-ccca-40de-a9eb-16ed0bb1e7cb-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Flow 'volume_create_manager' (b41be251-0497-45bc-89dc-464eaf4321f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c4af47-c0b0-411f-bb77-ad60fac244a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c4af47-c0b0-411f-bb77-ad60fac244a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1535375794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff7df59-e258-48d9-8d89-f8a46c2c5cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e27137faeea4aeba9df4769131ca735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:09Z,use_quota=True,user_id='abb8960b15b748fd97a859d0694e6e1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a04cd3-a6ef-4036-8c3a-0b030e7a386f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a04cd3-a6ef-4036-8c3a-0b030e7a386f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73c3af3-6e7b-4aa3-aa47-89c43f3b3fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73c3af3-6e7b-4aa3-aa47-89c43f3b3fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ff7df59-e258-48d9-8d89-f8a46c2c5cfb', 'volume_name': 'volume-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2fc6ad-6576-4d03-8b1a-2898bcb7592a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2fc6ad-6576-4d03-8b1a-2898bcb7592a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcaf1e01-03da-4987-ae71-b0317c5498c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:08 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Volume 9ff7df59-e258-48d9-8d89-f8a46c2c5cfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb', 'volume_size': 1}
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1535375794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff7df59-e258-48d9-8d89-f8a46c2c5cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e27137faeea4aeba9df4769131ca735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:09Z,use_quota=True,user_id='abb8960b15b748fd97a859d0694e6e1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Creating volume 9ff7df59-e258-48d9-8d89-f8a46c2c5cfb {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:22:08 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:22:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:08 devstack sudo[103406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb 1073741824
Sep 28 18:22:08 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:09 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb 1073741824" returned: 0 in 0.663s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:09 devstack sudo[103412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb
Sep 28 18:22:09 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:09 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb" returned: 0 in 0.350s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:22:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:09 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcaf1e01-03da-4987-ae71-b0317c5498c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:09 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e122e8-99d5-49e4-acc4-07b26479fb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:09 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Volume volume-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb (9ff7df59-e258-48d9-8d89-f8a46c2c5cfb): created successfully
Sep 28 18:22:09 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e122e8-99d5-49e4-acc4-07b26479fb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:09 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Flow 'volume_create_manager' (b41be251-0497-45bc-89dc-464eaf4321f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:22:09 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-02ef406c-2eb8-4aee-a3e0-a8f832730b28 tempest-TestMinimumBasicScenario-1828222173 None] Created volume successfully.
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Flow 'volume_create_manager' (fc387819-c845-4bf9-86fd-5343bcc02da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4c32e3-d70e-420a-be34-088e959dec88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4c32e3-d70e-420a-be34-088e959dec88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61875752-dfb0-4698-8e28-179602c28733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6baedd82d78425091b53074b1bf0ec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:12Z,use_quota=True,user_id='b82006ec22fc4b46b479278c4e2cdddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c67157-ee26-4dc1-a505-af26eb73abdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c67157-ee26-4dc1-a505-af26eb73abdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b308c6db-f323-4348-ba44-fc0b0c0950e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b308c6db-f323-4348-ba44-fc0b0c0950e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61875752-dfb0-4698-8e28-179602c28733', 'volume_name': 'volume-61875752-dfb0-4698-8e28-179602c28733', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6295f361-cb95-46c5-bd34-ef7305be4d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6295f361-cb95-46c5-bd34-ef7305be4d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9776f3-c075-448e-84c0-6a5fd44eb611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:12 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Volume 61875752-dfb0-4698-8e28-179602c28733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61875752-dfb0-4698-8e28-179602c28733', 'volume_size': 1}
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61875752-dfb0-4698-8e28-179602c28733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6baedd82d78425091b53074b1bf0ec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:12Z,use_quota=True,user_id='b82006ec22fc4b46b479278c4e2cdddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Creating volume 61875752-dfb0-4698-8e28-179602c28733 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:22:12 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-61875752-dfb0-4698-8e28-179602c28733 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-511a67b0-8681-42a7-b8b4-cc71cd98f0eb req-a7fe68b6-ece3-4ee0-94ce-031bbdb507b4 tempest-TestMinimumBasicScenario-1828222173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:12 devstack sudo[103426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-61875752-dfb0-4698-8e28-179602c28733 1073741824
Sep 28 18:22:12 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:13 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-61875752-dfb0-4698-8e28-179602c28733 1073741824" returned: 0 in 0.571s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-61875752-dfb0-4698-8e28-179602c28733 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:13 devstack sudo[103439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-61875752-dfb0-4698-8e28-179602c28733
Sep 28 18:22:13 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:13 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-61875752-dfb0-4698-8e28-179602c28733" returned: 0 in 0.305s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:13 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:22:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-511a67b0-8681-42a7-b8b4-cc71cd98f0eb req-a7fe68b6-ece3-4ee0-94ce-031bbdb507b4 tempest-TestMinimumBasicScenario-1828222173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.912s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9776f3-c075-448e-84c0-6a5fd44eb611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61875752-dfb0-4698-8e28-179602c28733', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e74518e-cbcc-4fef-9ae3-b25253abf6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-511a67b0-8681-42a7-b8b4-cc71cd98f0eb req-a7fe68b6-ece3-4ee0-94ce-031bbdb507b4 tempest-TestMinimumBasicScenario-1828222173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:13 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Volume volume-61875752-dfb0-4698-8e28-179602c28733 (61875752-dfb0-4698-8e28-179602c28733): created successfully
Sep 28 18:22:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e74518e-cbcc-4fef-9ae3-b25253abf6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Flow 'volume_create_manager' (fc387819-c845-4bf9-86fd-5343bcc02da0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:22:13 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-ea888aca-9675-47fd-aebc-eaa679942eba tempest-CinderUnicodeTest-1161737854 None] Created volume successfully.
Sep 28 18:22:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-511a67b0-8681-42a7-b8b4-cc71cd98f0eb req-a7fe68b6-ece3-4ee0-94ce-031bbdb507b4 tempest-TestMinimumBasicScenario-1828222173 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4501e92-2ad5-46bb-8583-3a496e48c47c', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:22:13 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-511a67b0-8681-42a7-b8b4-cc71cd98f0eb req-a7fe68b6-ece3-4ee0-94ce-031bbdb507b4 tempest-TestMinimumBasicScenario-1828222173 None] attachment_update completed successfully.
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=136,cinder:UPDATE=182,cinder:INSERT=53,cinder:DELETE=19 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=131,cinder:UPDATE=196,cinder:INSERT=52,cinder:DELETE=13 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Flow 'volume_create_manager' (c2c8f146-a412-4b62-aab9-62ea0eabd29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dda19b9-7a9b-4f8f-a808-343228e1c67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dda19b9-7a9b-4f8f-a808-343228e1c67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:22:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1994283007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0baa3f6-ff2b-4832-b718-b4611ed74ef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6baedd82d78425091b53074b1bf0ec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:15Z,use_quota=True,user_id='b82006ec22fc4b46b479278c4e2cdddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190f231a-69b0-41ea-9a1e-dda47ccd2bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190f231a-69b0-41ea-9a1e-dda47ccd2bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d66d1a-f942-4bbd-ad27-75aae39520b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d66d1a-f942-4bbd-ad27-75aae39520b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0baa3f6-ff2b-4832-b718-b4611ed74ef9', 'volume_name': 'volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261c1219-0dfa-4bbd-8072-087edbde44e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261c1219-0dfa-4bbd-8072-087edbde44e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74340bac-24f8-4a3a-bb76-ae1daadba96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:15 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Volume f0baa3f6-ff2b-4832-b718-b4611ed74ef9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9', 'volume_size': 1}
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:22:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1994283007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0baa3f6-ff2b-4832-b718-b4611ed74ef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6baedd82d78425091b53074b1bf0ec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:15Z,use_quota=True,user_id='b82006ec22fc4b46b479278c4e2cdddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Creating volume f0baa3f6-ff2b-4832-b718-b4611ed74ef9 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:22:15 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:15 devstack sudo[103863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9 1073741824
Sep 28 18:22:15 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:15 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9 1073741824" returned: 0 in 0.581s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:16 devstack sudo[103869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9
Sep 28 18:22:16 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:16 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9" returned: 0 in 0.317s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:22:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74340bac-24f8-4a3a-bb76-ae1daadba96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f443bab-1ef9-437d-8b88-87b28be4be89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:16 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Volume volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9 (f0baa3f6-ff2b-4832-b718-b4611ed74ef9): created successfully
Sep 28 18:22:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f443bab-1ef9-437d-8b88-87b28be4be89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Flow 'volume_create_manager' (c2c8f146-a412-4b62-aab9-62ea0eabd29a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:22:16 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-0d2f9aa2-bc97-4ae8-9f05-67667694706f tempest-CinderUnicodeTest-1161737854 None] Created volume successfully.
Sep 28 18:22:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-31e4df37-d9ba-4782-88ae-9fd922ba5985 tempest-CinderUnicodeTest-1161737854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-31e4df37-d9ba-4782-88ae-9fd922ba5985 tempest-CinderUnicodeTest-1161737854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-31e4df37-d9ba-4782-88ae-9fd922ba5985 tempest-CinderUnicodeTest-1161737854 None] Creating offline snapshot 220e8992-55e8-4776-b203-66ab44a29828 of volume f0baa3f6-ff2b-4832-b718-b4611ed74ef9 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:22:17 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd8d83b-94a8-428c-97be-7d003eebb8e7]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:22:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-31e4df37-d9ba-4782-88ae-9fd922ba5985 tempest-CinderUnicodeTest-1161737854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:18 devstack sudo[103872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9
Sep 28 18:22:18 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:18 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-31e4df37-d9ba-4782-88ae-9fd922ba5985 tempest-CinderUnicodeTest-1161737854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9" returned: 0 in 0.509s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-31e4df37-d9ba-4782-88ae-9fd922ba5985 tempest-CinderUnicodeTest-1161737854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.220e8992-55e8-4776-b203-66ab44a29828 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:18 devstack sudo[103878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.220e8992-55e8-4776-b203-66ab44a29828 1G
Sep 28 18:22:18 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:18 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-31e4df37-d9ba-4782-88ae-9fd922ba5985 tempest-CinderUnicodeTest-1161737854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.220e8992-55e8-4776-b203-66ab44a29828 1G" returned: 0 in 0.596s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-31e4df37-d9ba-4782-88ae-9fd922ba5985 tempest-CinderUnicodeTest-1161737854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.220e8992-55e8-4776-b203-66ab44a29828 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:19 devstack sudo[103886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.220e8992-55e8-4776-b203-66ab44a29828
Sep 28 18:22:19 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:19 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-31e4df37-d9ba-4782-88ae-9fd922ba5985 tempest-CinderUnicodeTest-1161737854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.220e8992-55e8-4776-b203-66ab44a29828" returned: 0 in 0.464s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:19 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-31e4df37-d9ba-4782-88ae-9fd922ba5985 tempest-CinderUnicodeTest-1161737854 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.220e8992-55e8-4776-b203-66ab44a29828 is being set with open permissions: ugo+rw
Sep 28 18:22:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-31e4df37-d9ba-4782-88ae-9fd922ba5985 tempest-CinderUnicodeTest-1161737854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.220e8992-55e8-4776-b203-66ab44a29828 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:19 devstack sudo[103893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.220e8992-55e8-4776-b203-66ab44a29828
Sep 28 18:22:19 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:19 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-31e4df37-d9ba-4782-88ae-9fd922ba5985 tempest-CinderUnicodeTest-1161737854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.220e8992-55e8-4776-b203-66ab44a29828" returned: 0 in 0.521s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-31e4df37-d9ba-4782-88ae-9fd922ba5985 tempest-CinderUnicodeTest-1161737854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:20 devstack sudo[103896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.info
Sep 28 18:22:20 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:20 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-31e4df37-d9ba-4782-88ae-9fd922ba5985 tempest-CinderUnicodeTest-1161737854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.info" returned: 0 in 0.378s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:20 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-31e4df37-d9ba-4782-88ae-9fd922ba5985 tempest-CinderUnicodeTest-1161737854 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.info is being set with open permissions: ugo+rw
Sep 28 18:22:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-31e4df37-d9ba-4782-88ae-9fd922ba5985 tempest-CinderUnicodeTest-1161737854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:20 devstack sudo[103926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.info
Sep 28 18:22:20 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:20 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-31e4df37-d9ba-4782-88ae-9fd922ba5985 tempest-CinderUnicodeTest-1161737854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.info" returned: 0 in 0.360s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-31e4df37-d9ba-4782-88ae-9fd922ba5985 tempest-CinderUnicodeTest-1161737854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.029s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:20 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-31e4df37-d9ba-4782-88ae-9fd922ba5985 tempest-CinderUnicodeTest-1161737854 None] Create snapshot completed successfully
Sep 28 18:22:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c9e431f4-92cf-491c-b9b4-8ae78c5b8cf6 tempest-CinderUnicodeTest-1161737854 None] Acquiring lock "cinder-220e8992-55e8-4776-b203-66ab44a29828-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:22:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c9e431f4-92cf-491c-b9b4-8ae78c5b8cf6 tempest-CinderUnicodeTest-1161737854 None] Lock "cinder-220e8992-55e8-4776-b203-66ab44a29828-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:22:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c9e431f4-92cf-491c-b9b4-8ae78c5b8cf6 tempest-CinderUnicodeTest-1161737854 None] Acquiring lock "cinder-quobyte-f0baa3f6-ff2b-4832-b718-b4611ed74ef9" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:22:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c9e431f4-92cf-491c-b9b4-8ae78c5b8cf6 tempest-CinderUnicodeTest-1161737854 None] Lock "cinder-quobyte-f0baa3f6-ff2b-4832-b718-b4611ed74ef9" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:22:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c9e431f4-92cf-491c-b9b4-8ae78c5b8cf6 tempest-CinderUnicodeTest-1161737854 None] Acquiring lock "cinder-quobyte-220e8992-55e8-4776-b203-66ab44a29828" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:22:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c9e431f4-92cf-491c-b9b4-8ae78c5b8cf6 tempest-CinderUnicodeTest-1161737854 None] Lock "cinder-quobyte-220e8992-55e8-4776-b203-66ab44a29828" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:22:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-c9e431f4-92cf-491c-b9b4-8ae78c5b8cf6 tempest-CinderUnicodeTest-1161737854 None] Deleting offline snapshot 220e8992-55e8-4776-b203-66ab44a29828 of volume f0baa3f6-ff2b-4832-b718-b4611ed74ef9 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:22:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-c9e431f4-92cf-491c-b9b4-8ae78c5b8cf6 tempest-CinderUnicodeTest-1161737854 None] snapshot_file for this snap is: volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.220e8992-55e8-4776-b203-66ab44a29828 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:22:21 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b62044-9c70-461f-804c-19da0a31f245]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:22:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c9e431f4-92cf-491c-b9b4-8ae78c5b8cf6 tempest-CinderUnicodeTest-1161737854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.220e8992-55e8-4776-b203-66ab44a29828 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:21 devstack sudo[103931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.220e8992-55e8-4776-b203-66ab44a29828
Sep 28 18:22:21 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:21 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c9e431f4-92cf-491c-b9b4-8ae78c5b8cf6 tempest-CinderUnicodeTest-1161737854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.220e8992-55e8-4776-b203-66ab44a29828" returned: 0 in 0.442s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-c9e431f4-92cf-491c-b9b4-8ae78c5b8cf6 tempest-CinderUnicodeTest-1161737854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:22:21 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64dffb6-bdeb-47b4-9736-34c979b6c11d]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:22:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c9e431f4-92cf-491c-b9b4-8ae78c5b8cf6 tempest-CinderUnicodeTest-1161737854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:21 devstack sudo[103936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9
Sep 28 18:22:21 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:22 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c9e431f4-92cf-491c-b9b4-8ae78c5b8cf6 tempest-CinderUnicodeTest-1161737854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9" returned: 0 in 0.433s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c9e431f4-92cf-491c-b9b4-8ae78c5b8cf6 tempest-CinderUnicodeTest-1161737854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.220e8992-55e8-4776-b203-66ab44a29828 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:22 devstack sudo[103942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.220e8992-55e8-4776-b203-66ab44a29828
Sep 28 18:22:22 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:22 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c9e431f4-92cf-491c-b9b4-8ae78c5b8cf6 tempest-CinderUnicodeTest-1161737854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.220e8992-55e8-4776-b203-66ab44a29828" returned: 0 in 0.402s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c9e431f4-92cf-491c-b9b4-8ae78c5b8cf6 tempest-CinderUnicodeTest-1161737854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.220e8992-55e8-4776-b203-66ab44a29828 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:22 devstack sudo[103947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.220e8992-55e8-4776-b203-66ab44a29828
Sep 28 18:22:22 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:22 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c9e431f4-92cf-491c-b9b4-8ae78c5b8cf6 tempest-CinderUnicodeTest-1161737854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9.220e8992-55e8-4776-b203-66ab44a29828" returned: 0 in 0.308s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c9e431f4-92cf-491c-b9b4-8ae78c5b8cf6 tempest-CinderUnicodeTest-1161737854 None] Lock "cinder-quobyte-220e8992-55e8-4776-b203-66ab44a29828" released by "_delete_snapshot" :: held 1.721s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:22:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c9e431f4-92cf-491c-b9b4-8ae78c5b8cf6 tempest-CinderUnicodeTest-1161737854 None] Lock "cinder-quobyte-f0baa3f6-ff2b-4832-b718-b4611ed74ef9" released by "delete_snapshot" :: held 1.761s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:22:23 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-c9e431f4-92cf-491c-b9b4-8ae78c5b8cf6 tempest-CinderUnicodeTest-1161737854 None] Created reservations ['b207803f-307b-4ca1-bc2f-7bbc85205c6f', 'e5e93c5c-d013-47a1-9448-15b3e9eaca9a', 'b72e202c-a0d9-47f9-a0f4-2b943b4adaa3', '27b38037-6d00-4e05-b4ce-6f74bb2ae99a'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:22:23 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-c9e431f4-92cf-491c-b9b4-8ae78c5b8cf6 tempest-CinderUnicodeTest-1161737854 None] Delete snapshot completed successfully.
Sep 28 18:22:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c9e431f4-92cf-491c-b9b4-8ae78c5b8cf6 tempest-CinderUnicodeTest-1161737854 None] Lock "cinder-220e8992-55e8-4776-b203-66ab44a29828-delete_snapshot" released by "delete_snapshot" :: held 1.951s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:22:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7800a4d7-bda2-4ccc-b1eb-ac1ab8ff0fe1 tempest-CinderUnicodeTest-1161737854 None] Acquiring lock "cinder-f0baa3f6-ff2b-4832-b718-b4611ed74ef9-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:22:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7800a4d7-bda2-4ccc-b1eb-ac1ab8ff0fe1 tempest-CinderUnicodeTest-1161737854 None] Lock "cinder-f0baa3f6-ff2b-4832-b718-b4611ed74ef9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:22:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7800a4d7-bda2-4ccc-b1eb-ac1ab8ff0fe1 tempest-CinderUnicodeTest-1161737854 None] Acquiring lock "cinder-quobyte-f0baa3f6-ff2b-4832-b718-b4611ed74ef9" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:22:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7800a4d7-bda2-4ccc-b1eb-ac1ab8ff0fe1 tempest-CinderUnicodeTest-1161737854 None] Lock "cinder-quobyte-f0baa3f6-ff2b-4832-b718-b4611ed74ef9" acquired by "delete_volume" :: waited 0.018s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:22:23 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1646ee7-2892-4b69-b6a9-66d6bdb13d11]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:22:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7800a4d7-bda2-4ccc-b1eb-ac1ab8ff0fe1 tempest-CinderUnicodeTest-1161737854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:23 devstack sudo[103952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9
Sep 28 18:22:23 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:23 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7800a4d7-bda2-4ccc-b1eb-ac1ab8ff0fe1 tempest-CinderUnicodeTest-1161737854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9" returned: 0 in 0.459s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7800a4d7-bda2-4ccc-b1eb-ac1ab8ff0fe1 tempest-CinderUnicodeTest-1161737854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:23 devstack sudo[103959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9
Sep 28 18:22:23 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:24 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7800a4d7-bda2-4ccc-b1eb-ac1ab8ff0fe1 tempest-CinderUnicodeTest-1161737854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-f0baa3f6-ff2b-4832-b718-b4611ed74ef9" returned: 0 in 0.292s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7800a4d7-bda2-4ccc-b1eb-ac1ab8ff0fe1 tempest-CinderUnicodeTest-1161737854 None] Lock "cinder-quobyte-f0baa3f6-ff2b-4832-b718-b4611ed74ef9" released by "delete_volume" :: held 0.832s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:22:24 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-7800a4d7-bda2-4ccc-b1eb-ac1ab8ff0fe1 tempest-CinderUnicodeTest-1161737854 None] Created reservations ['156d6fc5-cbcb-4cd7-a981-ba9923c70769', 'a00a36f0-d573-40c4-a58a-de1f2d266a7a', '8cb753f7-f755-4bbd-8460-8a10b461a5e2', '1fbf3f9d-acf6-4418-a016-4d1b1c5cd82c'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:22:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7800a4d7-bda2-4ccc-b1eb-ac1ab8ff0fe1 tempest-CinderUnicodeTest-1161737854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7800a4d7-bda2-4ccc-b1eb-ac1ab8ff0fe1 tempest-CinderUnicodeTest-1161737854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7800a4d7-bda2-4ccc-b1eb-ac1ab8ff0fe1 tempest-CinderUnicodeTest-1161737854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:22:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7800a4d7-bda2-4ccc-b1eb-ac1ab8ff0fe1 tempest-CinderUnicodeTest-1161737854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:22:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7800a4d7-bda2-4ccc-b1eb-ac1ab8ff0fe1 tempest-CinderUnicodeTest-1161737854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7800a4d7-bda2-4ccc-b1eb-ac1ab8ff0fe1 tempest-CinderUnicodeTest-1161737854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:24 devstack sudo[103962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:22:24 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d62d200f-7469-46a6-8ba4-572dd5a77403 tempest-CinderUnicodeTest-1161737854 None] Acquiring lock "cinder-61875752-dfb0-4698-8e28-179602c28733-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:22:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d62d200f-7469-46a6-8ba4-572dd5a77403 tempest-CinderUnicodeTest-1161737854 None] Lock "cinder-61875752-dfb0-4698-8e28-179602c28733-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:22:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d62d200f-7469-46a6-8ba4-572dd5a77403 tempest-CinderUnicodeTest-1161737854 None] Acquiring lock "cinder-quobyte-61875752-dfb0-4698-8e28-179602c28733" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:22:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d62d200f-7469-46a6-8ba4-572dd5a77403 tempest-CinderUnicodeTest-1161737854 None] Lock "cinder-quobyte-61875752-dfb0-4698-8e28-179602c28733" acquired by "delete_volume" :: waited 0.019s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:22:24 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f0432b-2edc-4578-a642-fc921cb3cbc1]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:22:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d62d200f-7469-46a6-8ba4-572dd5a77403 tempest-CinderUnicodeTest-1161737854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-61875752-dfb0-4698-8e28-179602c28733 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:24 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7800a4d7-bda2-4ccc-b1eb-ac1ab8ff0fe1 tempest-CinderUnicodeTest-1161737854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.294s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:24 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-7800a4d7-bda2-4ccc-b1eb-ac1ab8ff0fe1 tempest-CinderUnicodeTest-1161737854 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:22:24 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-7800a4d7-bda2-4ccc-b1eb-ac1ab8ff0fe1 tempest-CinderUnicodeTest-1161737854 None] Deleted volume successfully.
Sep 28 18:22:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7800a4d7-bda2-4ccc-b1eb-ac1ab8ff0fe1 tempest-CinderUnicodeTest-1161737854 None] Lock "cinder-f0baa3f6-ff2b-4832-b718-b4611ed74ef9-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:22:24 devstack sudo[103965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-61875752-dfb0-4698-8e28-179602c28733
Sep 28 18:22:24 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:25 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d62d200f-7469-46a6-8ba4-572dd5a77403 tempest-CinderUnicodeTest-1161737854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-61875752-dfb0-4698-8e28-179602c28733" returned: 0 in 0.391s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d62d200f-7469-46a6-8ba4-572dd5a77403 tempest-CinderUnicodeTest-1161737854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-61875752-dfb0-4698-8e28-179602c28733 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:25 devstack sudo[103970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-61875752-dfb0-4698-8e28-179602c28733
Sep 28 18:22:25 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:25 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d62d200f-7469-46a6-8ba4-572dd5a77403 tempest-CinderUnicodeTest-1161737854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-61875752-dfb0-4698-8e28-179602c28733" returned: 0 in 0.267s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d62d200f-7469-46a6-8ba4-572dd5a77403 tempest-CinderUnicodeTest-1161737854 None] Lock "cinder-quobyte-61875752-dfb0-4698-8e28-179602c28733" released by "delete_volume" :: held 0.710s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:22:25 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-d62d200f-7469-46a6-8ba4-572dd5a77403 tempest-CinderUnicodeTest-1161737854 None] Created reservations ['69222677-44de-416c-8c97-f35d06f084a9', 'c0bb13ee-2292-4297-ac48-12d8b281a3f1', 'e934925a-153d-44bf-b4ab-e23ef0efb871', '1a7fee02-e870-48fc-a2f7-07e07ee3c246'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:22:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d62d200f-7469-46a6-8ba4-572dd5a77403 tempest-CinderUnicodeTest-1161737854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d62d200f-7469-46a6-8ba4-572dd5a77403 tempest-CinderUnicodeTest-1161737854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:25 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d62d200f-7469-46a6-8ba4-572dd5a77403 tempest-CinderUnicodeTest-1161737854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:22:25 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d62d200f-7469-46a6-8ba4-572dd5a77403 tempest-CinderUnicodeTest-1161737854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:22:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d62d200f-7469-46a6-8ba4-572dd5a77403 tempest-CinderUnicodeTest-1161737854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d62d200f-7469-46a6-8ba4-572dd5a77403 tempest-CinderUnicodeTest-1161737854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:25 devstack sudo[103973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:22:25 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:25 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d62d200f-7469-46a6-8ba4-572dd5a77403 tempest-CinderUnicodeTest-1161737854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.267s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:25 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d62d200f-7469-46a6-8ba4-572dd5a77403 tempest-CinderUnicodeTest-1161737854 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:22:25 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d62d200f-7469-46a6-8ba4-572dd5a77403 tempest-CinderUnicodeTest-1161737854 None] Deleted volume successfully.
Sep 28 18:22:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d62d200f-7469-46a6-8ba4-572dd5a77403 tempest-CinderUnicodeTest-1161737854 None] Lock "cinder-61875752-dfb0-4698-8e28-179602c28733-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:22:34 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:22:34 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Flow 'volume_create_manager' (895ddea3-c55e-4172-9a55-f3bbbb5fa895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:22:34 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a331c9-facb-4ae0-a5d9-24784344ab05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:34 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a331c9-facb-4ae0-a5d9-24784344ab05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1787245501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec0d043-6c75-4e55-9640-b8d0aee0519d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b8f1570cbd40519c81b9fe86ef0fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:35Z,use_quota=True,user_id='f8955e4d690b4755b790412f0bc6f8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa227d6-668e-4564-b13c-efab88166523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa227d6-668e-4564-b13c-efab88166523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbdd4876-75ca-4832-b1fa-ebd16dfd1f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbdd4876-75ca-4832-b1fa-ebd16dfd1f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ec0d043-6c75-4e55-9640-b8d0aee0519d', 'volume_name': 'volume-1ec0d043-6c75-4e55-9640-b8d0aee0519d', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56f30e7-e5b2-4198-801f-4add173b5a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56f30e7-e5b2-4198-801f-4add173b5a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d7a83f-1d29-4495-babf-22f863cd100c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:35 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Volume 1ec0d043-6c75-4e55-9640-b8d0aee0519d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ec0d043-6c75-4e55-9640-b8d0aee0519d', 'volume_size': 1}
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1787245501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec0d043-6c75-4e55-9640-b8d0aee0519d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b8f1570cbd40519c81b9fe86ef0fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:35Z,use_quota=True,user_id='f8955e4d690b4755b790412f0bc6f8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Creating volume 1ec0d043-6c75-4e55-9640-b8d0aee0519d {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:22:35 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1ec0d043-6c75-4e55-9640-b8d0aee0519d 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:35 devstack sudo[104045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1ec0d043-6c75-4e55-9640-b8d0aee0519d 1073741824
Sep 28 18:22:35 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:35 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1ec0d043-6c75-4e55-9640-b8d0aee0519d 1073741824" returned: 0 in 0.558s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1ec0d043-6c75-4e55-9640-b8d0aee0519d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:35 devstack sudo[104058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1ec0d043-6c75-4e55-9640-b8d0aee0519d
Sep 28 18:22:35 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:35 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1ec0d043-6c75-4e55-9640-b8d0aee0519d" returned: 0 in 0.322s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:22:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d7a83f-1d29-4495-babf-22f863cd100c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ec0d043-6c75-4e55-9640-b8d0aee0519d', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144dc3fc-b2e5-4a3d-b2e1-9d416b09dbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:36 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Volume volume-1ec0d043-6c75-4e55-9640-b8d0aee0519d (1ec0d043-6c75-4e55-9640-b8d0aee0519d): created successfully
Sep 28 18:22:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144dc3fc-b2e5-4a3d-b2e1-9d416b09dbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:36 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Flow 'volume_create_manager' (895ddea3-c55e-4172-9a55-f3bbbb5fa895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:22:36 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-a667ebc2-9e1b-4f02-90a5-da62d3c37278 tempest-ProjectReaderTests-1741598471 None] Created volume successfully.
Sep 28 18:22:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b229831a-1427-4804-a8c0-1168941f5bd2 tempest-ProjectReaderTests-1741598471 None] Acquiring lock "cinder-1ec0d043-6c75-4e55-9640-b8d0aee0519d-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:22:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b229831a-1427-4804-a8c0-1168941f5bd2 tempest-ProjectReaderTests-1741598471 None] Lock "cinder-1ec0d043-6c75-4e55-9640-b8d0aee0519d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:22:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b229831a-1427-4804-a8c0-1168941f5bd2 tempest-ProjectReaderTests-1741598471 None] Acquiring lock "cinder-quobyte-1ec0d043-6c75-4e55-9640-b8d0aee0519d" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:22:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b229831a-1427-4804-a8c0-1168941f5bd2 tempest-ProjectReaderTests-1741598471 None] Lock "cinder-quobyte-1ec0d043-6c75-4e55-9640-b8d0aee0519d" acquired by "delete_volume" :: waited 0.018s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:22:37 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[687b724d-fac4-4838-8b6d-d59ef66db3d0]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:22:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b229831a-1427-4804-a8c0-1168941f5bd2 tempest-ProjectReaderTests-1741598471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1ec0d043-6c75-4e55-9640-b8d0aee0519d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:37 devstack sudo[104098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1ec0d043-6c75-4e55-9640-b8d0aee0519d
Sep 28 18:22:37 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:37 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b229831a-1427-4804-a8c0-1168941f5bd2 tempest-ProjectReaderTests-1741598471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1ec0d043-6c75-4e55-9640-b8d0aee0519d" returned: 0 in 0.458s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b229831a-1427-4804-a8c0-1168941f5bd2 tempest-ProjectReaderTests-1741598471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1ec0d043-6c75-4e55-9640-b8d0aee0519d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:37 devstack sudo[104103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1ec0d043-6c75-4e55-9640-b8d0aee0519d
Sep 28 18:22:37 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:38 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b229831a-1427-4804-a8c0-1168941f5bd2 tempest-ProjectReaderTests-1741598471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1ec0d043-6c75-4e55-9640-b8d0aee0519d" returned: 0 in 0.338s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b229831a-1427-4804-a8c0-1168941f5bd2 tempest-ProjectReaderTests-1741598471 None] Lock "cinder-quobyte-1ec0d043-6c75-4e55-9640-b8d0aee0519d" released by "delete_volume" :: held 0.859s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:22:38 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-b229831a-1427-4804-a8c0-1168941f5bd2 tempest-ProjectReaderTests-1741598471 None] Created reservations ['56e318e6-b198-4ca3-afca-ad9c98875e04', 'c0b8766f-b4e5-4a71-a46f-f3e779254179', '5b05af4a-a420-4e1c-9f9a-be069785ffee', '509d00a5-d29a-49f7-96a7-3d815a394702'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:22:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b229831a-1427-4804-a8c0-1168941f5bd2 tempest-ProjectReaderTests-1741598471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b229831a-1427-4804-a8c0-1168941f5bd2 tempest-ProjectReaderTests-1741598471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:38 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b229831a-1427-4804-a8c0-1168941f5bd2 tempest-ProjectReaderTests-1741598471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:22:38 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b229831a-1427-4804-a8c0-1168941f5bd2 tempest-ProjectReaderTests-1741598471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:22:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b229831a-1427-4804-a8c0-1168941f5bd2 tempest-ProjectReaderTests-1741598471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b229831a-1427-4804-a8c0-1168941f5bd2 tempest-ProjectReaderTests-1741598471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:38 devstack sudo[104108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:22:38 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:38 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b229831a-1427-4804-a8c0-1168941f5bd2 tempest-ProjectReaderTests-1741598471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.539s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:38 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-b229831a-1427-4804-a8c0-1168941f5bd2 tempest-ProjectReaderTests-1741598471 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:22:38 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-b229831a-1427-4804-a8c0-1168941f5bd2 tempest-ProjectReaderTests-1741598471 None] Deleted volume successfully.
Sep 28 18:22:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b229831a-1427-4804-a8c0-1168941f5bd2 tempest-ProjectReaderTests-1741598471 None] Lock "cinder-1ec0d043-6c75-4e55-9640-b8d0aee0519d-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Flow 'volume_create_manager' (2374d6ff-816a-42a6-b9a8-d0d66d45a9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27044be3-24d6-4972-adb4-e9fefc3686ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27044be3-24d6-4972-adb4-e9fefc3686ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1198493382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce4acc1-4b26-4a50-b700-a17b7061e604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b8f1570cbd40519c81b9fe86ef0fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:39Z,use_quota=True,user_id='f8955e4d690b4755b790412f0bc6f8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fde7e1a-8e43-4c09-a897-7a09e5a29fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fde7e1a-8e43-4c09-a897-7a09e5a29fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07390fad-abb8-445c-a0ff-a88fc18cb96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07390fad-abb8-445c-a0ff-a88fc18cb96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ce4acc1-4b26-4a50-b700-a17b7061e604', 'volume_name': 'volume-9ce4acc1-4b26-4a50-b700-a17b7061e604', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bfaafab-2a9d-49e5-a2f2-aad1bf2e94d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bfaafab-2a9d-49e5-a2f2-aad1bf2e94d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada9f64f-23e7-410e-8c2e-e54b614d9208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:39 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Volume 9ce4acc1-4b26-4a50-b700-a17b7061e604: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ce4acc1-4b26-4a50-b700-a17b7061e604', 'volume_size': 1}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1198493382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce4acc1-4b26-4a50-b700-a17b7061e604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b8f1570cbd40519c81b9fe86ef0fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:39Z,use_quota=True,user_id='f8955e4d690b4755b790412f0bc6f8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Creating volume 9ce4acc1-4b26-4a50-b700-a17b7061e604 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:22:39 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ce4acc1-4b26-4a50-b700-a17b7061e604 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:39 devstack sudo[104111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ce4acc1-4b26-4a50-b700-a17b7061e604 1073741824
Sep 28 18:22:39 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:39 devstack sudo[104113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:22:39 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:39 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.316s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:22:39 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ce4acc1-4b26-4a50-b700-a17b7061e604 1073741824" returned: 0 in 0.510s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ce4acc1-4b26-4a50-b700-a17b7061e604 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:39 devstack sudo[104119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ce4acc1-4b26-4a50-b700-a17b7061e604
Sep 28 18:22:39 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:40 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ce4acc1-4b26-4a50-b700-a17b7061e604" returned: 0 in 0.325s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:22:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada9f64f-23e7-410e-8c2e-e54b614d9208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ce4acc1-4b26-4a50-b700-a17b7061e604', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5bd5940-e94d-4996-8109-bdfa8568942a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:40 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Volume volume-9ce4acc1-4b26-4a50-b700-a17b7061e604 (9ce4acc1-4b26-4a50-b700-a17b7061e604): created successfully
Sep 28 18:22:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5bd5940-e94d-4996-8109-bdfa8568942a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Flow 'volume_create_manager' (2374d6ff-816a-42a6-b9a8-d0d66d45a9e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:22:40 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-b71a2105-9c82-4f9c-a94e-a6560f5bc802 tempest-ProjectReaderTests-1741598471 None] Created volume successfully.
Sep 28 18:22:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d172bfc5-b61e-4251-8761-d3e2253d6518 tempest-ProjectReaderTests-1741598471 None] Acquiring lock "cinder-9ce4acc1-4b26-4a50-b700-a17b7061e604-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:22:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d172bfc5-b61e-4251-8761-d3e2253d6518 tempest-ProjectReaderTests-1741598471 None] Lock "cinder-9ce4acc1-4b26-4a50-b700-a17b7061e604-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:22:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d172bfc5-b61e-4251-8761-d3e2253d6518 tempest-ProjectReaderTests-1741598471 None] Acquiring lock "cinder-quobyte-9ce4acc1-4b26-4a50-b700-a17b7061e604" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:22:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d172bfc5-b61e-4251-8761-d3e2253d6518 tempest-ProjectReaderTests-1741598471 None] Lock "cinder-quobyte-9ce4acc1-4b26-4a50-b700-a17b7061e604" acquired by "delete_volume" :: waited 0.015s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:22:41 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d179a539-9d03-4600-a2ac-5891f76a6b08]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:22:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d172bfc5-b61e-4251-8761-d3e2253d6518 tempest-ProjectReaderTests-1741598471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ce4acc1-4b26-4a50-b700-a17b7061e604 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:41 devstack sudo[104122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ce4acc1-4b26-4a50-b700-a17b7061e604
Sep 28 18:22:41 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:41 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d172bfc5-b61e-4251-8761-d3e2253d6518 tempest-ProjectReaderTests-1741598471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ce4acc1-4b26-4a50-b700-a17b7061e604" returned: 0 in 0.387s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d172bfc5-b61e-4251-8761-d3e2253d6518 tempest-ProjectReaderTests-1741598471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ce4acc1-4b26-4a50-b700-a17b7061e604 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:41 devstack sudo[104127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ce4acc1-4b26-4a50-b700-a17b7061e604
Sep 28 18:22:41 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:42 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d172bfc5-b61e-4251-8761-d3e2253d6518 tempest-ProjectReaderTests-1741598471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ce4acc1-4b26-4a50-b700-a17b7061e604" returned: 0 in 0.251s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d172bfc5-b61e-4251-8761-d3e2253d6518 tempest-ProjectReaderTests-1741598471 None] Lock "cinder-quobyte-9ce4acc1-4b26-4a50-b700-a17b7061e604" released by "delete_volume" :: held 0.678s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:22:42 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-d172bfc5-b61e-4251-8761-d3e2253d6518 tempest-ProjectReaderTests-1741598471 None] Created reservations ['5a9e85b8-4944-44fc-adca-82cc0ed87285', '21325068-cefc-47ed-a77b-38b4999a9f70', '67e68114-84d2-4f00-8943-51c50a9ddf9b', '6c8a1a70-5cd0-4757-82c7-cddefec937f2'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:22:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d172bfc5-b61e-4251-8761-d3e2253d6518 tempest-ProjectReaderTests-1741598471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d172bfc5-b61e-4251-8761-d3e2253d6518 tempest-ProjectReaderTests-1741598471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d172bfc5-b61e-4251-8761-d3e2253d6518 tempest-ProjectReaderTests-1741598471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:22:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d172bfc5-b61e-4251-8761-d3e2253d6518 tempest-ProjectReaderTests-1741598471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:22:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d172bfc5-b61e-4251-8761-d3e2253d6518 tempest-ProjectReaderTests-1741598471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d172bfc5-b61e-4251-8761-d3e2253d6518 tempest-ProjectReaderTests-1741598471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:42 devstack sudo[104130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:22:42 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:42 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d172bfc5-b61e-4251-8761-d3e2253d6518 tempest-ProjectReaderTests-1741598471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.248s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:42 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d172bfc5-b61e-4251-8761-d3e2253d6518 tempest-ProjectReaderTests-1741598471 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:22:42 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d172bfc5-b61e-4251-8761-d3e2253d6518 tempest-ProjectReaderTests-1741598471 None] Deleted volume successfully.
Sep 28 18:22:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d172bfc5-b61e-4251-8761-d3e2253d6518 tempest-ProjectReaderTests-1741598471 None] Lock "cinder-9ce4acc1-4b26-4a50-b700-a17b7061e604-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Flow 'volume_create_manager' (1058de37-8c93-4974-b671-9a24b276ff41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ea0265-05c9-4d49-b47c-224c32325701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ea0265-05c9-4d49-b47c-224c32325701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1831065682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b8f1570cbd40519c81b9fe86ef0fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:43Z,use_quota=True,user_id='f8955e4d690b4755b790412f0bc6f8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fca220e-7bf2-42ef-a447-f2967fa5f83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fca220e-7bf2-42ef-a447-f2967fa5f83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf4955a-2e6a-4538-9be5-8c155f47736a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf4955a-2e6a-4538-9be5-8c155f47736a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f', 'volume_name': 'volume-db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3811d40e-8c2b-48be-bc1a-2fa49971ce86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3811d40e-8c2b-48be-bc1a-2fa49971ce86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91b647c-e1f7-4b55-a345-0f74b8f1ffd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:43 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Volume db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f', 'volume_size': 1}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1831065682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b8f1570cbd40519c81b9fe86ef0fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:43Z,use_quota=True,user_id='f8955e4d690b4755b790412f0bc6f8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Creating volume db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:22:43 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:43 devstack sudo[104134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f 1073741824
Sep 28 18:22:43 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:43 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f 1073741824" returned: 0 in 0.388s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:43 devstack sudo[104139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f
Sep 28 18:22:43 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:43 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f" returned: 0 in 0.236s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91b647c-e1f7-4b55-a345-0f74b8f1ffd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (753123c7-7dfa-44f2-a421-09b1015c2ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:43 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Volume volume-db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f (db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f): created successfully
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (753123c7-7dfa-44f2-a421-09b1015c2ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Flow 'volume_create_manager' (1058de37-8c93-4974-b671-9a24b276ff41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:22:43 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-0078c395-d606-4010-886a-a0d445fc2480 tempest-ProjectReaderTests-1741598471 None] Created volume successfully.
Sep 28 18:22:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f648eb7f-8b30-4fd9-908b-eebf619903aa tempest-ProjectReaderTests-1741598471 None] Acquiring lock "cinder-db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:22:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f648eb7f-8b30-4fd9-908b-eebf619903aa tempest-ProjectReaderTests-1741598471 None] Lock "cinder-db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:22:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f648eb7f-8b30-4fd9-908b-eebf619903aa tempest-ProjectReaderTests-1741598471 None] Acquiring lock "cinder-quobyte-db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:22:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f648eb7f-8b30-4fd9-908b-eebf619903aa tempest-ProjectReaderTests-1741598471 None] Lock "cinder-quobyte-db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f" acquired by "delete_volume" :: waited 0.019s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:22:44 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc44f8c-8202-45ec-9b1c-dd5f809294f6]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:22:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f648eb7f-8b30-4fd9-908b-eebf619903aa tempest-ProjectReaderTests-1741598471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:44 devstack sudo[104142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f
Sep 28 18:22:44 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:44 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f648eb7f-8b30-4fd9-908b-eebf619903aa tempest-ProjectReaderTests-1741598471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f" returned: 0 in 0.427s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f648eb7f-8b30-4fd9-908b-eebf619903aa tempest-ProjectReaderTests-1741598471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:44 devstack sudo[104147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f
Sep 28 18:22:44 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:45 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f648eb7f-8b30-4fd9-908b-eebf619903aa tempest-ProjectReaderTests-1741598471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f" returned: 0 in 0.275s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f648eb7f-8b30-4fd9-908b-eebf619903aa tempest-ProjectReaderTests-1741598471 None] Lock "cinder-quobyte-db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f" released by "delete_volume" :: held 0.746s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-f648eb7f-8b30-4fd9-908b-eebf619903aa tempest-ProjectReaderTests-1741598471 None] Created reservations ['08f73913-b929-428e-864d-64952ab2a0fa', 'dfde4261-6509-4042-8800-1b058e3a69f9', '9a5ac791-3a01-4abd-9bf4-b46c2f5f0623', 'f9f9010e-e2ee-4702-a539-8ad4a382a59b'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f648eb7f-8b30-4fd9-908b-eebf619903aa tempest-ProjectReaderTests-1741598471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f648eb7f-8b30-4fd9-908b-eebf619903aa tempest-ProjectReaderTests-1741598471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f648eb7f-8b30-4fd9-908b-eebf619903aa tempest-ProjectReaderTests-1741598471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f648eb7f-8b30-4fd9-908b-eebf619903aa tempest-ProjectReaderTests-1741598471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f648eb7f-8b30-4fd9-908b-eebf619903aa tempest-ProjectReaderTests-1741598471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f648eb7f-8b30-4fd9-908b-eebf619903aa tempest-ProjectReaderTests-1741598471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:45 devstack sudo[104150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:22:45 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:45 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f648eb7f-8b30-4fd9-908b-eebf619903aa tempest-ProjectReaderTests-1741598471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.249s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-f648eb7f-8b30-4fd9-908b-eebf619903aa tempest-ProjectReaderTests-1741598471 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:22:45 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-f648eb7f-8b30-4fd9-908b-eebf619903aa tempest-ProjectReaderTests-1741598471 None] Deleted volume successfully.
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f648eb7f-8b30-4fd9-908b-eebf619903aa tempest-ProjectReaderTests-1741598471 None] Lock "cinder-db9a3df3-92b1-4ce0-9758-c3cb4bce9a4f-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Flow 'volume_create_manager' (e598aa3e-b5c8-4ed0-9bdc-80772353d6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610288ad-6310-4d24-b311-07b882eaf23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610288ad-6310-4d24-b311-07b882eaf23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-318252135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abaa0e99-e755-444e-97be-1a6c787426de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b8f1570cbd40519c81b9fe86ef0fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:46Z,use_quota=True,user_id='f8955e4d690b4755b790412f0bc6f8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7848a5-6bb9-4a13-93c5-be0084ea292c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7848a5-6bb9-4a13-93c5-be0084ea292c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c4818e-7263-46a4-ac8b-029ca05a6870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c4818e-7263-46a4-ac8b-029ca05a6870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abaa0e99-e755-444e-97be-1a6c787426de', 'volume_name': 'volume-abaa0e99-e755-444e-97be-1a6c787426de', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c2c7ff-a386-4481-8f9c-9e7d902e1a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c2c7ff-a386-4481-8f9c-9e7d902e1a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b09d62-73c2-44e6-8aab-fa07c49ddd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:45 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Volume abaa0e99-e755-444e-97be-1a6c787426de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abaa0e99-e755-444e-97be-1a6c787426de', 'volume_size': 1}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-318252135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abaa0e99-e755-444e-97be-1a6c787426de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b8f1570cbd40519c81b9fe86ef0fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:46Z,use_quota=True,user_id='f8955e4d690b4755b790412f0bc6f8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Creating volume abaa0e99-e755-444e-97be-1a6c787426de {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:22:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:22:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:22:46 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:22:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-abaa0e99-e755-444e-97be-1a6c787426de 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:46 devstack sudo[104153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-abaa0e99-e755-444e-97be-1a6c787426de 1073741824
Sep 28 18:22:46 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:46 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-abaa0e99-e755-444e-97be-1a6c787426de 1073741824" returned: 0 in 0.471s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-abaa0e99-e755-444e-97be-1a6c787426de {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:46 devstack sudo[104158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-abaa0e99-e755-444e-97be-1a6c787426de
Sep 28 18:22:46 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:46 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-abaa0e99-e755-444e-97be-1a6c787426de" returned: 0 in 0.307s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:22:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b09d62-73c2-44e6-8aab-fa07c49ddd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abaa0e99-e755-444e-97be-1a6c787426de', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5dd6a66-3a12-4ed6-8c11-a5c7cfe93396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:22:46 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Volume volume-abaa0e99-e755-444e-97be-1a6c787426de (abaa0e99-e755-444e-97be-1a6c787426de): created successfully
Sep 28 18:22:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5dd6a66-3a12-4ed6-8c11-a5c7cfe93396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:22:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Flow 'volume_create_manager' (e598aa3e-b5c8-4ed0-9bdc-80772353d6f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:22:46 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-389d2310-e7c8-45d3-baf2-25e1332298ea tempest-ProjectReaderTests-1741598471 None] Created volume successfully.
Sep 28 18:22:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-58ce9232-4301-4701-aa4b-dd9c7e5cd2c6 tempest-ProjectReaderTests-1741598471 None] Acquiring lock "cinder-abaa0e99-e755-444e-97be-1a6c787426de-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:22:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-58ce9232-4301-4701-aa4b-dd9c7e5cd2c6 tempest-ProjectReaderTests-1741598471 None] Lock "cinder-abaa0e99-e755-444e-97be-1a6c787426de-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:22:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-58ce9232-4301-4701-aa4b-dd9c7e5cd2c6 tempest-ProjectReaderTests-1741598471 None] Acquiring lock "cinder-quobyte-abaa0e99-e755-444e-97be-1a6c787426de" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:22:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-58ce9232-4301-4701-aa4b-dd9c7e5cd2c6 tempest-ProjectReaderTests-1741598471 None] Lock "cinder-quobyte-abaa0e99-e755-444e-97be-1a6c787426de" acquired by "delete_volume" :: waited 0.021s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:22:48 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f11b7ee-21de-4eec-9658-cbed784dae88]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:22:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-58ce9232-4301-4701-aa4b-dd9c7e5cd2c6 tempest-ProjectReaderTests-1741598471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-abaa0e99-e755-444e-97be-1a6c787426de {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:48 devstack sudo[104161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-abaa0e99-e755-444e-97be-1a6c787426de
Sep 28 18:22:48 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:48 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-58ce9232-4301-4701-aa4b-dd9c7e5cd2c6 tempest-ProjectReaderTests-1741598471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-abaa0e99-e755-444e-97be-1a6c787426de" returned: 0 in 0.419s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-58ce9232-4301-4701-aa4b-dd9c7e5cd2c6 tempest-ProjectReaderTests-1741598471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-abaa0e99-e755-444e-97be-1a6c787426de {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:48 devstack sudo[104166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-abaa0e99-e755-444e-97be-1a6c787426de
Sep 28 18:22:48 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:48 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-58ce9232-4301-4701-aa4b-dd9c7e5cd2c6 tempest-ProjectReaderTests-1741598471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-abaa0e99-e755-444e-97be-1a6c787426de" returned: 0 in 0.291s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-58ce9232-4301-4701-aa4b-dd9c7e5cd2c6 tempest-ProjectReaderTests-1741598471 None] Lock "cinder-quobyte-abaa0e99-e755-444e-97be-1a6c787426de" released by "delete_volume" :: held 0.758s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:22:48 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-58ce9232-4301-4701-aa4b-dd9c7e5cd2c6 tempest-ProjectReaderTests-1741598471 None] Created reservations ['53d7b227-0ffa-4924-b5b2-7fbc06628e06', '98d1afa7-b730-4c9e-9f7e-c7ab3c0500f8', '9ea22ed5-0886-41dc-a0af-feadde130c51', '9dd23569-78a1-4659-a5f2-ee95e38322a7'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:22:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-58ce9232-4301-4701-aa4b-dd9c7e5cd2c6 tempest-ProjectReaderTests-1741598471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:22:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-58ce9232-4301-4701-aa4b-dd9c7e5cd2c6 tempest-ProjectReaderTests-1741598471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:22:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-58ce9232-4301-4701-aa4b-dd9c7e5cd2c6 tempest-ProjectReaderTests-1741598471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:22:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-58ce9232-4301-4701-aa4b-dd9c7e5cd2c6 tempest-ProjectReaderTests-1741598471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:22:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-58ce9232-4301-4701-aa4b-dd9c7e5cd2c6 tempest-ProjectReaderTests-1741598471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:22:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-58ce9232-4301-4701-aa4b-dd9c7e5cd2c6 tempest-ProjectReaderTests-1741598471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:22:49 devstack sudo[104169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:22:49 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:22:49 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root
Sep 28 18:22:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-58ce9232-4301-4701-aa4b-dd9c7e5cd2c6 tempest-ProjectReaderTests-1741598471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.277s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:22:49 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-58ce9232-4301-4701-aa4b-dd9c7e5cd2c6 tempest-ProjectReaderTests-1741598471 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:22:49 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-58ce9232-4301-4701-aa4b-dd9c7e5cd2c6 tempest-ProjectReaderTests-1741598471 None] Deleted volume successfully.
Sep 28 18:22:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-58ce9232-4301-4701-aa4b-dd9c7e5cd2c6 tempest-ProjectReaderTests-1741598471 None] Lock "cinder-abaa0e99-e755-444e-97be-1a6c787426de-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:22:58 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=52,cinder:UPDATE=73,cinder:INSERT=15,cinder:DELETE=7 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:22:59 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=45,cinder:UPDATE=66,cinder:DELETE=5,cinder:INSERT=19 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:23:03 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-9f6acedb-ccb1-4956-91d9-cc5dd05398a5 req-8e65096e-3ecc-4079-b956-f42302a4188d tempest-TestMinimumBasicScenario-1828222173 None] Terminate volume connection completed successfully.
Sep 28 18:23:03 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-9f6acedb-ccb1-4956-91d9-cc5dd05398a5 req-8e65096e-3ecc-4079-b956-f42302a4188d tempest-TestMinimumBasicScenario-1828222173 None] Deleting attachment c4501e92-2ad5-46bb-8583-3a496e48c47c. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:23:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-296fa3b6-15db-4595-9f3c-862c0e82a623 tempest-TestMinimumBasicScenario-1828222173 None] Acquiring lock "cinder-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:23:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-296fa3b6-15db-4595-9f3c-862c0e82a623 tempest-TestMinimumBasicScenario-1828222173 None] Lock "cinder-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:23:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-296fa3b6-15db-4595-9f3c-862c0e82a623 tempest-TestMinimumBasicScenario-1828222173 None] Acquiring lock "cinder-quobyte-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:23:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-296fa3b6-15db-4595-9f3c-862c0e82a623 tempest-TestMinimumBasicScenario-1828222173 None] Lock "cinder-quobyte-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb" acquired by "delete_volume" :: waited 0.015s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:23:04 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[264620c5-2acf-44db-b9a7-773c38dea725]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:23:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-296fa3b6-15db-4595-9f3c-862c0e82a623 tempest-TestMinimumBasicScenario-1828222173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:23:04 devstack sudo[104196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb
Sep 28 18:23:04 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:23:04 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root
Sep 28 18:23:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-296fa3b6-15db-4595-9f3c-862c0e82a623 tempest-TestMinimumBasicScenario-1828222173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb" returned: 0 in 0.409s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:23:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-296fa3b6-15db-4595-9f3c-862c0e82a623 tempest-TestMinimumBasicScenario-1828222173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:23:05 devstack sudo[104201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb
Sep 28 18:23:05 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:23:05 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root
Sep 28 18:23:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-296fa3b6-15db-4595-9f3c-862c0e82a623 tempest-TestMinimumBasicScenario-1828222173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb" returned: 0 in 0.268s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:23:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-296fa3b6-15db-4595-9f3c-862c0e82a623 tempest-TestMinimumBasicScenario-1828222173 None] Lock "cinder-quobyte-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb" released by "delete_volume" :: held 0.726s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:23:05 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-296fa3b6-15db-4595-9f3c-862c0e82a623 tempest-TestMinimumBasicScenario-1828222173 None] Created reservations ['04c17f6c-7800-4807-9c13-b2837f93685e', '8bb2194c-8439-4790-9192-92044d9294ff', '3d306b09-5d3c-4e82-bdf9-11b026768230', 'c4ab5d29-8639-473f-9e58-a813d90244fa'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:23:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-296fa3b6-15db-4595-9f3c-862c0e82a623 tempest-TestMinimumBasicScenario-1828222173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:23:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-296fa3b6-15db-4595-9f3c-862c0e82a623 tempest-TestMinimumBasicScenario-1828222173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:23:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-296fa3b6-15db-4595-9f3c-862c0e82a623 tempest-TestMinimumBasicScenario-1828222173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:23:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-296fa3b6-15db-4595-9f3c-862c0e82a623 tempest-TestMinimumBasicScenario-1828222173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:23:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-296fa3b6-15db-4595-9f3c-862c0e82a623 tempest-TestMinimumBasicScenario-1828222173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:23:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-296fa3b6-15db-4595-9f3c-862c0e82a623 tempest-TestMinimumBasicScenario-1828222173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:23:05 devstack sudo[104204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:23:05 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:23:05 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root
Sep 28 18:23:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-296fa3b6-15db-4595-9f3c-862c0e82a623 tempest-TestMinimumBasicScenario-1828222173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.257s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:23:05 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-296fa3b6-15db-4595-9f3c-862c0e82a623 tempest-TestMinimumBasicScenario-1828222173 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:23:05 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-296fa3b6-15db-4595-9f3c-862c0e82a623 tempest-TestMinimumBasicScenario-1828222173 None] Deleted volume successfully.
Sep 28 18:23:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-296fa3b6-15db-4595-9f3c-862c0e82a623 tempest-TestMinimumBasicScenario-1828222173 None] Lock "cinder-9ff7df59-e258-48d9-8d89-f8a46c2c5cfb-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:23:15 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:UPDATE=9,cinder:SELECT=7,cinder:INSERT=2 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:23:15 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:23:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:23:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:23:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:23:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:23:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:23:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:23:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:23:39 devstack sudo[104282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:23:39 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:23:39 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root
Sep 28 18:23:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.443s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:23:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:23:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:23:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:23:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:24:19 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:24:19 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Flow 'volume_create_manager' (1ffb01fa-1d35-4d02-bd28-ee5751fe2d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:24:19 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2127cdad-65b4-46fd-9247-2e6fe88b7d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:24:19 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2127cdad-65b4-46fd-9247-2e6fe88b7d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-872998362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79616994-2d60-48c5-9a99-262a739040bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0afe059a157843a395cbe68fb1590505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:20Z,use_quota=True,user_id='f6e2731341d541448a4991e89c526da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:24:19 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b00c7b-7ecf-454c-b1b8-1703c2510529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:24:19 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b00c7b-7ecf-454c-b1b8-1703c2510529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:24:19 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36064491-e510-42ed-9b0b-e540ae2fafd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:24:19 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36064491-e510-42ed-9b0b-e540ae2fafd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79616994-2d60-48c5-9a99-262a739040bb', 'volume_name': 'volume-79616994-2d60-48c5-9a99-262a739040bb', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:24:19 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e85869-59e4-4207-b3f0-3e1ed0af6d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:24:19 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e85869-59e4-4207-b3f0-3e1ed0af6d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:24:19 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1321e1cd-51e2-49b2-b0b0-7012f4e4e852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:24:19 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Volume 79616994-2d60-48c5-9a99-262a739040bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79616994-2d60-48c5-9a99-262a739040bb', 'volume_size': 1}
Sep 28 18:24:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:24:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:24:19 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-872998362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79616994-2d60-48c5-9a99-262a739040bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0afe059a157843a395cbe68fb1590505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:20Z,use_quota=True,user_id='f6e2731341d541448a4991e89c526da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:24:19 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Creating volume 79616994-2d60-48c5-9a99-262a739040bb {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:24:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:24:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:24:19 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:24:19 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:24:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:24:19 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:24:19 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:24:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-79616994-2d60-48c5-9a99-262a739040bb 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:24:19 devstack sudo[104427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-79616994-2d60-48c5-9a99-262a739040bb 1073741824
Sep 28 18:24:19 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:24:20 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root
Sep 28 18:24:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-79616994-2d60-48c5-9a99-262a739040bb 1073741824" returned: 0 in 0.466s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:24:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-79616994-2d60-48c5-9a99-262a739040bb {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:24:20 devstack sudo[104433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-79616994-2d60-48c5-9a99-262a739040bb
Sep 28 18:24:20 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:24:20 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root
Sep 28 18:24:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-79616994-2d60-48c5-9a99-262a739040bb" returned: 0 in 0.283s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:24:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:24:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:24:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1321e1cd-51e2-49b2-b0b0-7012f4e4e852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79616994-2d60-48c5-9a99-262a739040bb', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:24:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ba2e69-aff9-4fa4-9e24-2c4cb158009d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:24:20 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Volume volume-79616994-2d60-48c5-9a99-262a739040bb (79616994-2d60-48c5-9a99-262a739040bb): created successfully
Sep 28 18:24:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ba2e69-aff9-4fa4-9e24-2c4cb158009d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:24:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Flow 'volume_create_manager' (1ffb01fa-1d35-4d02-bd28-ee5751fe2d30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:24:20 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-8367324e-adc0-4d70-8b85-9ad247a15450 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Created volume successfully.
Sep 28 18:24:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-951b114e-9079-493d-86cf-4adce2685c70 req-27f1b75c-fcba-4c3e-b5b4-8087f3dd5c6f tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:24:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-951b114e-9079-493d-86cf-4adce2685c70 req-27f1b75c-fcba-4c3e-b5b4-8087f3dd5c6f tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:24:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-951b114e-9079-493d-86cf-4adce2685c70 req-27f1b75c-fcba-4c3e-b5b4-8087f3dd5c6f tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:24:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-951b114e-9079-493d-86cf-4adce2685c70 req-27f1b75c-fcba-4c3e-b5b4-8087f3dd5c6f tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-79616994-2d60-48c5-9a99-262a739040bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03f8cdd8-a98b-450e-b1a7-2c9e1be162b2', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:24:22 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-951b114e-9079-493d-86cf-4adce2685c70 req-27f1b75c-fcba-4c3e-b5b4-8087f3dd5c6f tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] attachment_update completed successfully.
Sep 28 18:24:26 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-3d972972-ae21-4e8b-9a26-4826a7e9c511 req-9e35fced-128e-452d-82be-5443a0a75550 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Terminate volume connection completed successfully.
Sep 28 18:24:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-3d972972-ae21-4e8b-9a26-4826a7e9c511 req-9e35fced-128e-452d-82be-5443a0a75550 tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Deleting attachment 03f8cdd8-a98b-450e-b1a7-2c9e1be162b2. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:24:27 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7230d323-9cdd-4fad-8d09-4ffdbf66accf tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Acquiring lock "cinder-79616994-2d60-48c5-9a99-262a739040bb-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:24:27 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7230d323-9cdd-4fad-8d09-4ffdbf66accf tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Lock "cinder-79616994-2d60-48c5-9a99-262a739040bb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:24:27 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7230d323-9cdd-4fad-8d09-4ffdbf66accf tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Acquiring lock "cinder-quobyte-79616994-2d60-48c5-9a99-262a739040bb" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:24:27 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7230d323-9cdd-4fad-8d09-4ffdbf66accf tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Lock "cinder-quobyte-79616994-2d60-48c5-9a99-262a739040bb" acquired by "delete_volume" :: waited 0.023s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:24:27 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3826c4a-e583-43be-9ebb-1d7416d79e92]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:24:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7230d323-9cdd-4fad-8d09-4ffdbf66accf tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-79616994-2d60-48c5-9a99-262a739040bb {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:24:27 devstack sudo[104899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-79616994-2d60-48c5-9a99-262a739040bb
Sep 28 18:24:27 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:24:27 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root
Sep 28 18:24:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7230d323-9cdd-4fad-8d09-4ffdbf66accf tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-79616994-2d60-48c5-9a99-262a739040bb" returned: 0 in 0.388s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:24:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7230d323-9cdd-4fad-8d09-4ffdbf66accf tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-79616994-2d60-48c5-9a99-262a739040bb {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:24:27 devstack sudo[104904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-79616994-2d60-48c5-9a99-262a739040bb
Sep 28 18:24:27 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:24:27 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root
Sep 28 18:24:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7230d323-9cdd-4fad-8d09-4ffdbf66accf tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-79616994-2d60-48c5-9a99-262a739040bb" returned: 0 in 0.291s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:24:27 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7230d323-9cdd-4fad-8d09-4ffdbf66accf tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Lock "cinder-quobyte-79616994-2d60-48c5-9a99-262a739040bb" released by "delete_volume" :: held 0.728s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:24:27 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-7230d323-9cdd-4fad-8d09-4ffdbf66accf tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Created reservations ['f6d74c61-c91d-40ac-89c4-2cbb4ada0d50', 'f2676d31-1f13-4834-a0b2-3e5a96fd2728', '514f875e-b8f1-4793-9d23-fc93ac1d691b', '53158a40-b197-4d53-8078-f2a13d0a6614'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:24:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7230d323-9cdd-4fad-8d09-4ffdbf66accf tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:24:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7230d323-9cdd-4fad-8d09-4ffdbf66accf tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:24:28 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7230d323-9cdd-4fad-8d09-4ffdbf66accf tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:24:28 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7230d323-9cdd-4fad-8d09-4ffdbf66accf tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:24:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7230d323-9cdd-4fad-8d09-4ffdbf66accf tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:24:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7230d323-9cdd-4fad-8d09-4ffdbf66accf tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:24:28 devstack sudo[104907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:24:28 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:24:28 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root
Sep 28 18:24:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7230d323-9cdd-4fad-8d09-4ffdbf66accf tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.300s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:24:28 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-7230d323-9cdd-4fad-8d09-4ffdbf66accf tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:24:28 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-7230d323-9cdd-4fad-8d09-4ffdbf66accf tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Deleted volume successfully.
Sep 28 18:24:28 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7230d323-9cdd-4fad-8d09-4ffdbf66accf tempest-TestServerVolumeAttachScenarioOldVersion-57862364 None] Lock "cinder-79616994-2d60-48c5-9a99-262a739040bb-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:24:38 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=13,cinder:INSERT=2,cinder:DELETE=1,cinder:UPDATE=11 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:24:38 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=16,cinder:UPDATE=14,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:24:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:24:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:24:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:24:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:24:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:24:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:24:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:24:39 devstack sudo[104976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:24:39 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:24:39 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root
Sep 28 18:24:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.297s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:24:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:24:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:24:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:24:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:25:09 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=1 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:25:09 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:UPDATE=1 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:25:11 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:25:11 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Flow 'volume_create_manager' (75bbbef9-b787-4d1b-a953-23c3829957dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:25:11 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5faa62c-c438-4a90-a392-c1e7513528c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:25:11 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5faa62c-c438-4a90-a392-c1e7513528c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-301261078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ef782f-3834-40d5-b1bb-a65b359c7242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde796acdd9441e68280520d5babadf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:12Z,use_quota=True,user_id='d3f59807a3a2426097b4a57b5c3b927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:25:11 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebbd6ad8-2255-4094-ab03-2c1272e3ca14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:25:11 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebbd6ad8-2255-4094-ab03-2c1272e3ca14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:25:11 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a50026-b26a-4129-90a9-786c7dae1992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:25:11 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a50026-b26a-4129-90a9-786c7dae1992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55ef782f-3834-40d5-b1bb-a65b359c7242', 'volume_name': 'volume-55ef782f-3834-40d5-b1bb-a65b359c7242', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:25:11 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c19c792b-995e-489f-bca5-1c15aebae2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:25:11 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c19c792b-995e-489f-bca5-1c15aebae2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:25:11 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1eb3262-bf41-4da7-929d-03066b5fcc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:25:11 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Volume 55ef782f-3834-40d5-b1bb-a65b359c7242: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55ef782f-3834-40d5-b1bb-a65b359c7242', 'volume_size': 1}
Sep 28 18:25:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:25:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:25:11 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-301261078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ef782f-3834-40d5-b1bb-a65b359c7242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde796acdd9441e68280520d5babadf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:12Z,use_quota=True,user_id='d3f59807a3a2426097b4a57b5c3b927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:25:11 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Creating volume 55ef782f-3834-40d5-b1bb-a65b359c7242 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:25:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:25:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:25:11 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:25:11 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:25:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:25:11 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:25:11 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:25:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-55ef782f-3834-40d5-b1bb-a65b359c7242 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:25:11 devstack sudo[104993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-55ef782f-3834-40d5-b1bb-a65b359c7242 1073741824
Sep 28 18:25:11 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Flow 'volume_create_manager' (94cbf4b1-487e-41cd-8cd3-e4df8b758bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1fad5e6-578a-4d81-ae0c-5e5214134084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1fad5e6-578a-4d81-ae0c-5e5214134084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1683284977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af4883e-e9f5-4f6d-ac73-1621015e9182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde796acdd9441e68280520d5babadf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:12Z,use_quota=True,user_id='d3f59807a3a2426097b4a57b5c3b927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9835f8c-5e37-4ee9-9903-02f5972efe54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9835f8c-5e37-4ee9-9903-02f5972efe54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7689082d-cf8e-497c-817a-a170d02696ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7689082d-cf8e-497c-817a-a170d02696ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6af4883e-e9f5-4f6d-ac73-1621015e9182', 'volume_name': 'volume-6af4883e-e9f5-4f6d-ac73-1621015e9182', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8e4c06-7ede-42bc-8cdd-82e1c9586005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8e4c06-7ede-42bc-8cdd-82e1c9586005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f0f8d3-1a97-4d4a-8a18-932d2b56dac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:25:12 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Volume 6af4883e-e9f5-4f6d-ac73-1621015e9182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6af4883e-e9f5-4f6d-ac73-1621015e9182', 'volume_size': 1}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:25:12 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-55ef782f-3834-40d5-b1bb-a65b359c7242 1073741824" returned: 0 in 0.636s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-55ef782f-3834-40d5-b1bb-a65b359c7242 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:25:12 devstack sudo[104999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-55ef782f-3834-40d5-b1bb-a65b359c7242
Sep 28 18:25:12 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:25:12 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-55ef782f-3834-40d5-b1bb-a65b359c7242" returned: 0 in 0.314s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.483s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1683284977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af4883e-e9f5-4f6d-ac73-1621015e9182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde796acdd9441e68280520d5babadf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:12Z,use_quota=True,user_id='d3f59807a3a2426097b4a57b5c3b927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Creating volume 6af4883e-e9f5-4f6d-ac73-1621015e9182 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:25:12 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6af4883e-e9f5-4f6d-ac73-1621015e9182 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1eb3262-bf41-4da7-929d-03066b5fcc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55ef782f-3834-40d5-b1bb-a65b359c7242', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f87602-ecec-4012-b40d-97dbea85cdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:25:12 devstack sudo[105002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6af4883e-e9f5-4f6d-ac73-1621015e9182 1073741824
Sep 28 18:25:12 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:25:12 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Volume volume-55ef782f-3834-40d5-b1bb-a65b359c7242 (55ef782f-3834-40d5-b1bb-a65b359c7242): created successfully
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f87602-ecec-4012-b40d-97dbea85cdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:25:12 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Flow 'volume_create_manager' (75bbbef9-b787-4d1b-a953-23c3829957dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:25:12 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-51bdcf91-332b-4712-99f3-94db0c33cafb tempest-TestServerVolumeAttachmentScenario-1935727346 None] Created volume successfully.
Sep 28 18:25:13 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root
Sep 28 18:25:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6af4883e-e9f5-4f6d-ac73-1621015e9182 1073741824" returned: 0 in 0.576s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:25:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6af4883e-e9f5-4f6d-ac73-1621015e9182 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:25:13 devstack sudo[105009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6af4883e-e9f5-4f6d-ac73-1621015e9182
Sep 28 18:25:13 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:25:13 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root
Sep 28 18:25:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6af4883e-e9f5-4f6d-ac73-1621015e9182" returned: 0 in 0.266s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:25:13 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:25:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:25:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f0f8d3-1a97-4d4a-8a18-932d2b56dac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af4883e-e9f5-4f6d-ac73-1621015e9182', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:25:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b244c2-368e-42aa-8c0a-41e0a85b3564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:25:13 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Volume volume-6af4883e-e9f5-4f6d-ac73-1621015e9182 (6af4883e-e9f5-4f6d-ac73-1621015e9182): created successfully
Sep 28 18:25:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b244c2-368e-42aa-8c0a-41e0a85b3564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:25:13 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Flow 'volume_create_manager' (94cbf4b1-487e-41cd-8cd3-e4df8b758bef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:25:13 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-205985f9-dfcf-409f-abb4-477c89cd255c tempest-TestServerVolumeAttachmentScenario-1935727346 None] Created volume successfully.
Sep 28 18:25:23 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:UPDATE=5,cinder:SELECT=5,cinder:INSERT=1 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:25:23 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=3,cinder:UPDATE=7,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:25:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:25:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:25:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:25:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:25:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:25:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:25:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:25:39 devstack sudo[105598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:25:39 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:25:39 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root
Sep 28 18:25:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.284s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:25:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:25:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:25:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:25:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:25:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-46747c85-88cd-4275-b128-e5a7b35e4c24 req-e1e9e526-683f-4a4d-bd84-b67a93f16ad1 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:25:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-46747c85-88cd-4275-b128-e5a7b35e4c24 req-e1e9e526-683f-4a4d-bd84-b67a93f16ad1 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:25:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-46747c85-88cd-4275-b128-e5a7b35e4c24 req-e1e9e526-683f-4a4d-bd84-b67a93f16ad1 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:25:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-46747c85-88cd-4275-b128-e5a7b35e4c24 req-e1e9e526-683f-4a4d-bd84-b67a93f16ad1 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-55ef782f-3834-40d5-b1bb-a65b359c7242', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67013da8-88c4-47f9-90b8-55396fd83010', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:25:46 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-46747c85-88cd-4275-b128-e5a7b35e4c24 req-e1e9e526-683f-4a4d-bd84-b67a93f16ad1 tempest-TestServerVolumeAttachmentScenario-1935727346 None] attachment_update completed successfully.
Sep 28 18:25:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-5c9738ef-81a8-4f5c-a439-99a8386c0174 req-f0b42619-748b-443f-959f-c74a87968635 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:25:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-5c9738ef-81a8-4f5c-a439-99a8386c0174 req-f0b42619-748b-443f-959f-c74a87968635 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:25:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-5c9738ef-81a8-4f5c-a439-99a8386c0174 req-f0b42619-748b-443f-959f-c74a87968635 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:25:50 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-5c9738ef-81a8-4f5c-a439-99a8386c0174 req-f0b42619-748b-443f-959f-c74a87968635 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-6af4883e-e9f5-4f6d-ac73-1621015e9182', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30cb5d3f-caf0-4674-b74b-599861561cc6', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:25:50 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-5c9738ef-81a8-4f5c-a439-99a8386c0174 req-f0b42619-748b-443f-959f-c74a87968635 tempest-TestServerVolumeAttachmentScenario-1935727346 None] attachment_update completed successfully.
Sep 28 18:25:52 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-e0a57dcf-bb1b-42d2-8831-33c23ecbb714 req-7ea37457-7484-480a-bca9-0add05487afa tempest-TestServerVolumeAttachmentScenario-1935727346 None] Terminate volume connection completed successfully.
Sep 28 18:25:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-e0a57dcf-bb1b-42d2-8831-33c23ecbb714 req-7ea37457-7484-480a-bca9-0add05487afa tempest-TestServerVolumeAttachmentScenario-1935727346 None] Deleting attachment 30cb5d3f-caf0-4674-b74b-599861561cc6. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:25:54 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-f7f38d91-3163-4ae6-ae89-976345a6fe04 req-76ccf0b3-88af-440b-95dc-546319a3f00a tempest-TestServerVolumeAttachmentScenario-1935727346 None] Terminate volume connection completed successfully.
Sep 28 18:25:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-f7f38d91-3163-4ae6-ae89-976345a6fe04 req-76ccf0b3-88af-440b-95dc-546319a3f00a tempest-TestServerVolumeAttachmentScenario-1935727346 None] Deleting attachment 67013da8-88c4-47f9-90b8-55396fd83010. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:25:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d3aff162-668b-439b-abfd-bc2c60ab122f tempest-TestServerVolumeAttachmentScenario-1935727346 None] Acquiring lock "cinder-6af4883e-e9f5-4f6d-ac73-1621015e9182-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:25:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d3aff162-668b-439b-abfd-bc2c60ab122f tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "cinder-6af4883e-e9f5-4f6d-ac73-1621015e9182-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:25:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d3aff162-668b-439b-abfd-bc2c60ab122f tempest-TestServerVolumeAttachmentScenario-1935727346 None] Acquiring lock "cinder-quobyte-6af4883e-e9f5-4f6d-ac73-1621015e9182" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:25:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d3aff162-668b-439b-abfd-bc2c60ab122f tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "cinder-quobyte-6af4883e-e9f5-4f6d-ac73-1621015e9182" acquired by "delete_volume" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:25:58 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6488fabf-8372-4c9a-89a5-b23ea5356040]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:25:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d3aff162-668b-439b-abfd-bc2c60ab122f tempest-TestServerVolumeAttachmentScenario-1935727346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6af4883e-e9f5-4f6d-ac73-1621015e9182 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:25:59 devstack sudo[106114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6af4883e-e9f5-4f6d-ac73-1621015e9182
Sep 28 18:25:59 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:25:59 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root
Sep 28 18:25:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d3aff162-668b-439b-abfd-bc2c60ab122f tempest-TestServerVolumeAttachmentScenario-1935727346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6af4883e-e9f5-4f6d-ac73-1621015e9182" returned: 0 in 0.430s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:25:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d3aff162-668b-439b-abfd-bc2c60ab122f tempest-TestServerVolumeAttachmentScenario-1935727346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6af4883e-e9f5-4f6d-ac73-1621015e9182 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:25:59 devstack sudo[106119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6af4883e-e9f5-4f6d-ac73-1621015e9182
Sep 28 18:25:59 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:25:59 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root
Sep 28 18:25:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d3aff162-668b-439b-abfd-bc2c60ab122f tempest-TestServerVolumeAttachmentScenario-1935727346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6af4883e-e9f5-4f6d-ac73-1621015e9182" returned: 0 in 0.262s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:25:59 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d3aff162-668b-439b-abfd-bc2c60ab122f tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "cinder-quobyte-6af4883e-e9f5-4f6d-ac73-1621015e9182" released by "delete_volume" :: held 0.752s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:25:59 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-d3aff162-668b-439b-abfd-bc2c60ab122f tempest-TestServerVolumeAttachmentScenario-1935727346 None] Created reservations ['e641ccd8-26ff-4a83-9907-e3b754de8f6c', 'fd2265c5-2333-4f49-874e-e9fa36fc2c13', '47137182-b65e-4f23-86e0-031a8e7921de', 'a6058a0a-e453-4948-8465-30f791d6544a'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:25:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d3aff162-668b-439b-abfd-bc2c60ab122f tempest-TestServerVolumeAttachmentScenario-1935727346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:25:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d3aff162-668b-439b-abfd-bc2c60ab122f tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:25:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d3aff162-668b-439b-abfd-bc2c60ab122f tempest-TestServerVolumeAttachmentScenario-1935727346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:25:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d3aff162-668b-439b-abfd-bc2c60ab122f tempest-TestServerVolumeAttachmentScenario-1935727346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:25:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d3aff162-668b-439b-abfd-bc2c60ab122f tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:25:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d3aff162-668b-439b-abfd-bc2c60ab122f tempest-TestServerVolumeAttachmentScenario-1935727346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:25:59 devstack sudo[106122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:25:59 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:25:59 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9b5e6dc4-e1eb-4914-a4b7-d3303a791885 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Acquiring lock "cinder-55ef782f-3834-40d5-b1bb-a65b359c7242-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:26:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9b5e6dc4-e1eb-4914-a4b7-d3303a791885 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "cinder-55ef782f-3834-40d5-b1bb-a65b359c7242-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:26:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9b5e6dc4-e1eb-4914-a4b7-d3303a791885 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Acquiring lock "cinder-quobyte-55ef782f-3834-40d5-b1bb-a65b359c7242" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:26:00 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root
Sep 28 18:26:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9b5e6dc4-e1eb-4914-a4b7-d3303a791885 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "cinder-quobyte-55ef782f-3834-40d5-b1bb-a65b359c7242" acquired by "delete_volume" :: waited 0.024s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:26:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d3aff162-668b-439b-abfd-bc2c60ab122f tempest-TestServerVolumeAttachmentScenario-1935727346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.302s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:26:00 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d3aff162-668b-439b-abfd-bc2c60ab122f tempest-TestServerVolumeAttachmentScenario-1935727346 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:26:00 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d3aff162-668b-439b-abfd-bc2c60ab122f tempest-TestServerVolumeAttachmentScenario-1935727346 None] Deleted volume successfully.
Sep 28 18:26:00 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[394657f5-7385-4127-8e2f-91dcb167596a]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:26:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9b5e6dc4-e1eb-4914-a4b7-d3303a791885 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-55ef782f-3834-40d5-b1bb-a65b359c7242 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:26:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d3aff162-668b-439b-abfd-bc2c60ab122f tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "cinder-6af4883e-e9f5-4f6d-ac73-1621015e9182-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:26:00 devstack sudo[106125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-55ef782f-3834-40d5-b1bb-a65b359c7242
Sep 28 18:26:00 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:26:00 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root
Sep 28 18:26:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9b5e6dc4-e1eb-4914-a4b7-d3303a791885 tempest-TestServerVolumeAttachmentScenario-1935727346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-55ef782f-3834-40d5-b1bb-a65b359c7242" returned: 0 in 0.420s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:26:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9b5e6dc4-e1eb-4914-a4b7-d3303a791885 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-55ef782f-3834-40d5-b1bb-a65b359c7242 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:26:00 devstack sudo[106130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-55ef782f-3834-40d5-b1bb-a65b359c7242
Sep 28 18:26:00 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:26:00 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root
Sep 28 18:26:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9b5e6dc4-e1eb-4914-a4b7-d3303a791885 tempest-TestServerVolumeAttachmentScenario-1935727346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-55ef782f-3834-40d5-b1bb-a65b359c7242" returned: 0 in 0.276s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:26:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9b5e6dc4-e1eb-4914-a4b7-d3303a791885 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "cinder-quobyte-55ef782f-3834-40d5-b1bb-a65b359c7242" released by "delete_volume" :: held 0.756s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:26:00 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-9b5e6dc4-e1eb-4914-a4b7-d3303a791885 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Created reservations ['697fcaf6-4b3e-477c-9877-fe34c663ca36', '60744cdf-95c5-4f41-a1e2-53670c6fa161', '84cb511e-8b2c-4219-9e3d-26c65c975007', 'd2fe1428-1b6b-42ba-92c6-2554716939db'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:26:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9b5e6dc4-e1eb-4914-a4b7-d3303a791885 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:26:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9b5e6dc4-e1eb-4914-a4b7-d3303a791885 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:26:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9b5e6dc4-e1eb-4914-a4b7-d3303a791885 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:26:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9b5e6dc4-e1eb-4914-a4b7-d3303a791885 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:26:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9b5e6dc4-e1eb-4914-a4b7-d3303a791885 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:26:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9b5e6dc4-e1eb-4914-a4b7-d3303a791885 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:26:01 devstack sudo[106133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:26:01 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:26:01 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root
Sep 28 18:26:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9b5e6dc4-e1eb-4914-a4b7-d3303a791885 tempest-TestServerVolumeAttachmentScenario-1935727346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.288s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:26:01 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-9b5e6dc4-e1eb-4914-a4b7-d3303a791885 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:26:01 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-9b5e6dc4-e1eb-4914-a4b7-d3303a791885 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Deleted volume successfully.
Sep 28 18:26:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9b5e6dc4-e1eb-4914-a4b7-d3303a791885 tempest-TestServerVolumeAttachmentScenario-1935727346 None] Lock "cinder-55ef782f-3834-40d5-b1bb-a65b359c7242-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:26:10 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=22,cinder:UPDATE=18,cinder:INSERT=3 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:26:11 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=28,cinder:UPDATE=20,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:26:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:26:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:26:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:26:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:26:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:26:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:26:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:26:39 devstack sudo[106192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:26:39 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:26:39 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root
Sep 28 18:26:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.275s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:26:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:26:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:26:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:26:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:26:41 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:26:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Flow 'volume_create_manager' (4b8ce70f-f5f3-4bbc-b49e-6183b52812de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:26:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09cbc436-fe86-4cb2-a222-6531b5ef11a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:26:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09cbc436-fe86-4cb2-a222-6531b5ef11a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1257982476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b04cf48-6786-42db-a7c1-8510c84bde4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fccbc20f7f14522998a834202492896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:42Z,use_quota=True,user_id='aa30fb8538424619ad5fdc685312edcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:26:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c0d45f-4b14-4eeb-859f-7393caffee0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:26:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c0d45f-4b14-4eeb-859f-7393caffee0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:26:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8982638f-7409-46a9-bad1-248ce0ed1f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:26:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8982638f-7409-46a9-bad1-248ce0ed1f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b04cf48-6786-42db-a7c1-8510c84bde4c', 'volume_name': 'volume-8b04cf48-6786-42db-a7c1-8510c84bde4c', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:26:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095ec978-389f-41df-ad3a-6e4f80fb323b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:26:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095ec978-389f-41df-ad3a-6e4f80fb323b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:26:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100a867b-d34b-4a52-8c34-9d325a92910d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:26:41 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Volume 8b04cf48-6786-42db-a7c1-8510c84bde4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b04cf48-6786-42db-a7c1-8510c84bde4c', 'volume_size': 1}
Sep 28 18:26:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:26:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:26:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1257982476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b04cf48-6786-42db-a7c1-8510c84bde4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fccbc20f7f14522998a834202492896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:42Z,use_quota=True,user_id='aa30fb8538424619ad5fdc685312edcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:26:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Creating volume 8b04cf48-6786-42db-a7c1-8510c84bde4c {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:26:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:26:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:26:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:26:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:26:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:26:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:26:41 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:26:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:26:41 devstack sudo[106195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c 1073741824
Sep 28 18:26:41 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:26:42 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root
Sep 28 18:26:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c 1073741824" returned: 0 in 0.541s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:26:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:26:42 devstack sudo[106201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c
Sep 28 18:26:42 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:26:42 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root
Sep 28 18:26:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c" returned: 0 in 0.300s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:26:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:26:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:26:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100a867b-d34b-4a52-8c34-9d325a92910d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b04cf48-6786-42db-a7c1-8510c84bde4c', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:26:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19de3b9-929d-4520-8433-be510ff97c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:26:42 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Volume volume-8b04cf48-6786-42db-a7c1-8510c84bde4c (8b04cf48-6786-42db-a7c1-8510c84bde4c): created successfully
Sep 28 18:26:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19de3b9-929d-4520-8433-be510ff97c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:26:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Flow 'volume_create_manager' (4b8ce70f-f5f3-4bbc-b49e-6183b52812de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:26:42 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-49b1d61c-616a-440b-a084-9594160d29ef tempest-TestStampPattern-754072325 None] Created volume successfully.
Sep 28 18:26:52 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:26:52 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:27:09 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=1 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:27:09 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:UPDATE=1 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:27:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-1bfe215e-2bbe-469e-afa5-13fae6861e58 req-cde7c9ba-5bc8-48bc-8b52-a2e962134dd7 tempest-TestStampPattern-754072325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:27:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-1bfe215e-2bbe-469e-afa5-13fae6861e58 req-cde7c9ba-5bc8-48bc-8b52-a2e962134dd7 tempest-TestStampPattern-754072325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:27:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-1bfe215e-2bbe-469e-afa5-13fae6861e58 req-cde7c9ba-5bc8-48bc-8b52-a2e962134dd7 tempest-TestStampPattern-754072325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:27:14 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-1bfe215e-2bbe-469e-afa5-13fae6861e58 req-cde7c9ba-5bc8-48bc-8b52-a2e962134dd7 tempest-TestStampPattern-754072325 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-8b04cf48-6786-42db-a7c1-8510c84bde4c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be6f1b27-b294-4719-93d8-4d8e1ce4dd18', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:27:14 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-1bfe215e-2bbe-469e-afa5-13fae6861e58 req-cde7c9ba-5bc8-48bc-8b52-a2e962134dd7 tempest-TestStampPattern-754072325 None] attachment_update completed successfully.
Sep 28 18:27:19 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-925c98e9-bead-4353-ad07-3b30e417f75e req-cf177927-054d-4bff-a64b-2473a5778140 tempest-TestStampPattern-754072325 None] Terminate volume connection completed successfully.
Sep 28 18:27:19 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-925c98e9-bead-4353-ad07-3b30e417f75e req-cf177927-054d-4bff-a64b-2473a5778140 tempest-TestStampPattern-754072325 None] Deleting attachment be6f1b27-b294-4719-93d8-4d8e1ce4dd18. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:27:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-89226be4-523c-42ae-8502-9be3168cfb79 tempest-TestStampPattern-754072325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:27:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-89226be4-523c-42ae-8502-9be3168cfb79 tempest-TestStampPattern-754072325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:27:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-89226be4-523c-42ae-8502-9be3168cfb79 tempest-TestStampPattern-754072325 None] Creating offline snapshot 4bd1bfcd-c48f-4fcf-86af-9a01c9b89637 of volume 8b04cf48-6786-42db-a7c1-8510c84bde4c {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:27:20 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3a6c6f-9751-49fc-a765-0032fd873d8d]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:27:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-89226be4-523c-42ae-8502-9be3168cfb79 tempest-TestStampPattern-754072325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:27:20 devstack sudo[106834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c
Sep 28 18:27:20 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:27:21 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root
Sep 28 18:27:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-89226be4-523c-42ae-8502-9be3168cfb79 tempest-TestStampPattern-754072325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c" returned: 0 in 0.425s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:27:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-89226be4-523c-42ae-8502-9be3168cfb79 tempest-TestStampPattern-754072325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:27:21 devstack sudo[106841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637 1G
Sep 28 18:27:21 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:27:21 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root
Sep 28 18:27:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-89226be4-523c-42ae-8502-9be3168cfb79 tempest-TestStampPattern-754072325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637 1G" returned: 0 in 0.481s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:27:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-89226be4-523c-42ae-8502-9be3168cfb79 tempest-TestStampPattern-754072325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b04cf48-6786-42db-a7c1-8510c84bde4c -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:27:21 devstack sudo[106846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b04cf48-6786-42db-a7c1-8510c84bde4c -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637
Sep 28 18:27:21 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:27:21 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root
Sep 28 18:27:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-89226be4-523c-42ae-8502-9be3168cfb79 tempest-TestStampPattern-754072325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b04cf48-6786-42db-a7c1-8510c84bde4c -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637" returned: 0 in 0.359s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:27:21 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-89226be4-523c-42ae-8502-9be3168cfb79 tempest-TestStampPattern-754072325 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637 is being set with open permissions: ugo+rw
Sep 28 18:27:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-89226be4-523c-42ae-8502-9be3168cfb79 tempest-TestStampPattern-754072325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:27:21 devstack sudo[106851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637
Sep 28 18:27:21 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:27:22 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root
Sep 28 18:27:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-89226be4-523c-42ae-8502-9be3168cfb79 tempest-TestStampPattern-754072325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637" returned: 0 in 0.340s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:27:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-89226be4-523c-42ae-8502-9be3168cfb79 tempest-TestStampPattern-754072325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:27:22 devstack sudo[106854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.info
Sep 28 18:27:22 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:27:22 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root
Sep 28 18:27:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-89226be4-523c-42ae-8502-9be3168cfb79 tempest-TestStampPattern-754072325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.info" returned: 0 in 0.296s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:27:22 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-89226be4-523c-42ae-8502-9be3168cfb79 tempest-TestStampPattern-754072325 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.info is being set with open permissions: ugo+rw
Sep 28 18:27:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-89226be4-523c-42ae-8502-9be3168cfb79 tempest-TestStampPattern-754072325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:27:22 devstack sudo[106857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.info
Sep 28 18:27:22 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:27:22 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root
Sep 28 18:27:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-89226be4-523c-42ae-8502-9be3168cfb79 tempest-TestStampPattern-754072325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.info" returned: 0 in 0.262s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:27:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-89226be4-523c-42ae-8502-9be3168cfb79 tempest-TestStampPattern-754072325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.269s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:27:22 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-89226be4-523c-42ae-8502-9be3168cfb79 tempest-TestStampPattern-754072325 None] Create snapshot completed successfully
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Flow 'volume_create_manager' (1b84eba5-6a47-4724-b0ba-97b177bd7ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd9ba96-c248-47e3-bf46-7a7a467c41d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd9ba96-c248-47e3-bf46-7a7a467c41d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-767162924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9534422-5c45-46b5-9418-9712fa5aab4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fccbc20f7f14522998a834202492896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4bd1bfcd-c48f-4fcf-86af-9a01c9b89637,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:31Z,use_quota=True,user_id='aa30fb8538424619ad5fdc685312edcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac2741d-4226-43c6-8577-a00ca7186df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac2741d-4226-43c6-8577-a00ca7186df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d21ab8aa-bbeb-4a39-b817-75fc54aa07ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d21ab8aa-bbeb-4a39-b817-75fc54aa07ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b9534422-5c45-46b5-9418-9712fa5aab4f', 'volume_name': 'volume-b9534422-5c45-46b5-9418-9712fa5aab4f', 'volume_size': 1, 'snapshot_id': '4bd1bfcd-c48f-4fcf-86af-9a01c9b89637'}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43794ae-4b39-4efb-9117-e45fa425a15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43794ae-4b39-4efb-9117-e45fa425a15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0801fe85-5f15-4eb5-8080-aa949554ba11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:27:30 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Volume b9534422-5c45-46b5-9418-9712fa5aab4f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b9534422-5c45-46b5-9418-9712fa5aab4f', 'volume_size': 1, 'snapshot_id': '4bd1bfcd-c48f-4fcf-86af-9a01c9b89637'}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Acquiring lock "cinder-quobyte-4bd1bfcd-c48f-4fcf-86af-9a01c9b89637-b9534422-5c45-46b5-9418-9712fa5aab4f" by "_create_volume_from_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Lock "cinder-quobyte-4bd1bfcd-c48f-4fcf-86af-9a01c9b89637-b9534422-5c45-46b5-9418-9712fa5aab4f" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Creating volume b9534422-5c45-46b5-9418-9712fa5aab4f from snapshot 4bd1bfcd-c48f-4fcf-86af-9a01c9b89637 {{(pid=87046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Acquiring lock "cinder-quobyte-b9534422-5c45-46b5-9418-9712fa5aab4f" by "_copy_volume_from_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Lock "cinder-quobyte-b9534422-5c45-46b5-9418-9712fa5aab4f" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] snapshot: 4bd1bfcd-c48f-4fcf-86af-9a01c9b89637, volume: b9534422-5c45-46b5-9418-9712fa5aab4f,  {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd35f40-7d89-4380-b679-bc253c3747ff]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:27:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:27:31 devstack sudo[106892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637
Sep 28 18:27:31 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:27:31 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root
Sep 28 18:27:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637" returned: 0 in 0.430s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:27:31 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b04cf48-6786-42db-a7c1-8510c84bde4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:27:31 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54b7220-9c12-4ec7-b718-59e378347989]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:27:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:27:31 devstack sudo[106898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c
Sep 28 18:27:31 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:27:31 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root
Sep 28 18:27:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c" returned: 0 in 0.448s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:27:31 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 28 18:27:31 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Creating direct copy from snapshot {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 28 18:27:31 devstack cinder-volume[87046]: DEBUG cinder.utils [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Path /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b9534422-5c45-46b5-9418-9712fa5aab4f not found in is_blk_device check {{(pid=87046) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 28 18:27:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b9534422-5c45-46b5-9418-9712fa5aab4f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:27:31 devstack sudo[106906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b9534422-5c45-46b5-9418-9712fa5aab4f
Sep 28 18:27:31 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:27:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:27:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:27:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:27:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:27:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:27:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:27:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:27:39 devstack sudo[106982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:27:39 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:27:40 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root
Sep 28 18:27:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.563s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:27:40 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:27:40 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:27:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:27:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:27:40 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=17,cinder:UPDATE=1 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:27:40 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=9,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:27:41 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root
Sep 28 18:27:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b9534422-5c45-46b5-9418-9712fa5aab4f" returned: 0 in 9.732s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:27:41 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Image conversion details: src /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c, size 1024.00 MB, duration 9.73 sec, destination /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b9534422-5c45-46b5-9418-9712fa5aab4f {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:27:41 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Converted 1024.00 MB image at 105.21 MB/s
Sep 28 18:27:41 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b9534422-5c45-46b5-9418-9712fa5aab4f is being set with open permissions: ugo+rw
Sep 28 18:27:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b9534422-5c45-46b5-9418-9712fa5aab4f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:27:41 devstack sudo[107012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b9534422-5c45-46b5-9418-9712fa5aab4f
Sep 28 18:27:41 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:27:41 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root
Sep 28 18:27:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b9534422-5c45-46b5-9418-9712fa5aab4f" returned: 0 in 0.336s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:27:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Lock "cinder-quobyte-b9534422-5c45-46b5-9418-9712fa5aab4f" released by "_copy_volume_from_snapshot" :: held 11.070s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:27:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Lock "cinder-quobyte-4bd1bfcd-c48f-4fcf-86af-9a01c9b89637-b9534422-5c45-46b5-9418-9712fa5aab4f" released by "_create_volume_from_snapshot" :: held 11.155s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:27:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.174s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:27:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0801fe85-5f15-4eb5-8080-aa949554ba11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9534422-5c45-46b5-9418-9712fa5aab4f', 'volume_size': 1, 'snapshot_id': '4bd1bfcd-c48f-4fcf-86af-9a01c9b89637'}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:27:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92356f3d-8243-4b1b-b60e-e6f9c446778b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:27:42 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Volume volume-b9534422-5c45-46b5-9418-9712fa5aab4f (b9534422-5c45-46b5-9418-9712fa5aab4f): created successfully
Sep 28 18:27:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92356f3d-8243-4b1b-b60e-e6f9c446778b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:27:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Flow 'volume_create_manager' (1b84eba5-6a47-4724-b0ba-97b177bd7ced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:27:42 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-7f5c4c02-6a49-4e38-859b-859e66e0c287 tempest-TestStampPattern-754072325 None] Created volume successfully.
Sep 28 18:27:52 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:27:52 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:28:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-ecb28fcc-9cc7-4767-8736-b75bc5e748bb req-1c14ced2-dbd3-4a28-887f-f23c1aeb1b2d tempest-TestStampPattern-754072325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:28:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-ecb28fcc-9cc7-4767-8736-b75bc5e748bb req-1c14ced2-dbd3-4a28-887f-f23c1aeb1b2d tempest-TestStampPattern-754072325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:28:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [req-ecb28fcc-9cc7-4767-8736-b75bc5e748bb req-1c14ced2-dbd3-4a28-887f-f23c1aeb1b2d tempest-TestStampPattern-754072325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:28:24 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-ecb28fcc-9cc7-4767-8736-b75bc5e748bb req-1c14ced2-dbd3-4a28-887f-f23c1aeb1b2d tempest-TestStampPattern-754072325 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898', 'name': 'volume-b9534422-5c45-46b5-9418-9712fa5aab4f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de04f56d-eb5e-4dd2-a297-3b5fbd52ac7a', 'enforce_multipath': True} {{(pid=87046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 28 18:28:24 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-ecb28fcc-9cc7-4767-8736-b75bc5e748bb req-1c14ced2-dbd3-4a28-887f-f23c1aeb1b2d tempest-TestStampPattern-754072325 None] attachment_update completed successfully.
Sep 28 18:28:28 devstack cinder-volume[87046]: INFO cinder.volume.manager [req-cc0b4ec8-325d-4c26-b4e0-99215ab99e16 req-ea7a9400-af53-4a2d-ac61-d570dc91f8ec tempest-TestStampPattern-754072325 None] Terminate volume connection completed successfully.
Sep 28 18:28:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [req-cc0b4ec8-325d-4c26-b4e0-99215ab99e16 req-ea7a9400-af53-4a2d-ac61-d570dc91f8ec tempest-TestStampPattern-754072325 None] Deleting attachment de04f56d-eb5e-4dd2-a297-3b5fbd52ac7a. {{(pid=87046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 28 18:28:32 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4ca08818-dfdb-424f-9dcb-1d42ba0246e9 tempest-TestStampPattern-754072325 None] Acquiring lock "cinder-b9534422-5c45-46b5-9418-9712fa5aab4f-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:28:32 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4ca08818-dfdb-424f-9dcb-1d42ba0246e9 tempest-TestStampPattern-754072325 None] Lock "cinder-b9534422-5c45-46b5-9418-9712fa5aab4f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:28:32 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4ca08818-dfdb-424f-9dcb-1d42ba0246e9 tempest-TestStampPattern-754072325 None] Acquiring lock "cinder-quobyte-b9534422-5c45-46b5-9418-9712fa5aab4f" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:28:32 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4ca08818-dfdb-424f-9dcb-1d42ba0246e9 tempest-TestStampPattern-754072325 None] Lock "cinder-quobyte-b9534422-5c45-46b5-9418-9712fa5aab4f" acquired by "delete_volume" :: waited 0.017s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:28:32 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94c9d5c-176d-477f-a4eb-8193977f7142]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:28:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4ca08818-dfdb-424f-9dcb-1d42ba0246e9 tempest-TestStampPattern-754072325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b9534422-5c45-46b5-9418-9712fa5aab4f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:28:32 devstack sudo[107598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b9534422-5c45-46b5-9418-9712fa5aab4f
Sep 28 18:28:32 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:28:33 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root
Sep 28 18:28:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4ca08818-dfdb-424f-9dcb-1d42ba0246e9 tempest-TestStampPattern-754072325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b9534422-5c45-46b5-9418-9712fa5aab4f" returned: 0 in 0.436s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:28:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4ca08818-dfdb-424f-9dcb-1d42ba0246e9 tempest-TestStampPattern-754072325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b9534422-5c45-46b5-9418-9712fa5aab4f {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:28:33 devstack sudo[107603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b9534422-5c45-46b5-9418-9712fa5aab4f
Sep 28 18:28:33 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:28:33 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root
Sep 28 18:28:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4ca08818-dfdb-424f-9dcb-1d42ba0246e9 tempest-TestStampPattern-754072325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b9534422-5c45-46b5-9418-9712fa5aab4f" returned: 0 in 0.292s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:28:33 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4ca08818-dfdb-424f-9dcb-1d42ba0246e9 tempest-TestStampPattern-754072325 None] Lock "cinder-quobyte-b9534422-5c45-46b5-9418-9712fa5aab4f" released by "delete_volume" :: held 0.775s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:28:33 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-4ca08818-dfdb-424f-9dcb-1d42ba0246e9 tempest-TestStampPattern-754072325 None] Created reservations ['4d94bcf1-25ff-4ee9-9896-f31925fd346c', '285fd5a6-77c2-4bdb-aca6-c620b8faceec', '96a359e2-3bb3-418d-9e00-fb149bc820d5', '87d7595b-694e-4d9c-9496-96346c88c067'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:28:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-4ca08818-dfdb-424f-9dcb-1d42ba0246e9 tempest-TestStampPattern-754072325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:28:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-4ca08818-dfdb-424f-9dcb-1d42ba0246e9 tempest-TestStampPattern-754072325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:28:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-4ca08818-dfdb-424f-9dcb-1d42ba0246e9 tempest-TestStampPattern-754072325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:28:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-4ca08818-dfdb-424f-9dcb-1d42ba0246e9 tempest-TestStampPattern-754072325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:28:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-4ca08818-dfdb-424f-9dcb-1d42ba0246e9 tempest-TestStampPattern-754072325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:28:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4ca08818-dfdb-424f-9dcb-1d42ba0246e9 tempest-TestStampPattern-754072325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:28:33 devstack sudo[107607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:28:33 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:28:33 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root
Sep 28 18:28:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4ca08818-dfdb-424f-9dcb-1d42ba0246e9 tempest-TestStampPattern-754072325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.288s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:28:33 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-4ca08818-dfdb-424f-9dcb-1d42ba0246e9 tempest-TestStampPattern-754072325 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:28:33 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-4ca08818-dfdb-424f-9dcb-1d42ba0246e9 tempest-TestStampPattern-754072325 None] Deleted volume successfully.
Sep 28 18:28:34 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4ca08818-dfdb-424f-9dcb-1d42ba0246e9 tempest-TestStampPattern-754072325 None] Lock "cinder-b9534422-5c45-46b5-9418-9712fa5aab4f-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:28:34 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e1bf3a56-52f5-4c27-a8ec-1f72807c4d93 tempest-TestStampPattern-754072325 None] Acquiring lock "cinder-4bd1bfcd-c48f-4fcf-86af-9a01c9b89637-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:28:34 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e1bf3a56-52f5-4c27-a8ec-1f72807c4d93 tempest-TestStampPattern-754072325 None] Lock "cinder-4bd1bfcd-c48f-4fcf-86af-9a01c9b89637-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:28:34 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e1bf3a56-52f5-4c27-a8ec-1f72807c4d93 tempest-TestStampPattern-754072325 None] Acquiring lock "cinder-quobyte-8b04cf48-6786-42db-a7c1-8510c84bde4c" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:28:34 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e1bf3a56-52f5-4c27-a8ec-1f72807c4d93 tempest-TestStampPattern-754072325 None] Lock "cinder-quobyte-8b04cf48-6786-42db-a7c1-8510c84bde4c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:28:34 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e1bf3a56-52f5-4c27-a8ec-1f72807c4d93 tempest-TestStampPattern-754072325 None] Acquiring lock "cinder-quobyte-4bd1bfcd-c48f-4fcf-86af-9a01c9b89637" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:28:34 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e1bf3a56-52f5-4c27-a8ec-1f72807c4d93 tempest-TestStampPattern-754072325 None] Lock "cinder-quobyte-4bd1bfcd-c48f-4fcf-86af-9a01c9b89637" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:28:34 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-e1bf3a56-52f5-4c27-a8ec-1f72807c4d93 tempest-TestStampPattern-754072325 None] Deleting offline snapshot 4bd1bfcd-c48f-4fcf-86af-9a01c9b89637 of volume 8b04cf48-6786-42db-a7c1-8510c84bde4c {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:28:34 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-e1bf3a56-52f5-4c27-a8ec-1f72807c4d93 tempest-TestStampPattern-754072325 None] snapshot_file for this snap is: volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:28:34 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c066f75-201a-492a-8b5c-ef26dae928d9]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:28:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e1bf3a56-52f5-4c27-a8ec-1f72807c4d93 tempest-TestStampPattern-754072325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:28:34 devstack sudo[107610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637
Sep 28 18:28:34 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:28:34 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root
Sep 28 18:28:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e1bf3a56-52f5-4c27-a8ec-1f72807c4d93 tempest-TestStampPattern-754072325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637" returned: 0 in 0.465s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:28:34 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-e1bf3a56-52f5-4c27-a8ec-1f72807c4d93 tempest-TestStampPattern-754072325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b04cf48-6786-42db-a7c1-8510c84bde4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:28:34 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7fbfd3-6c98-477a-b4b5-b03de4b1b867]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:28:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e1bf3a56-52f5-4c27-a8ec-1f72807c4d93 tempest-TestStampPattern-754072325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:28:34 devstack sudo[107651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c
Sep 28 18:28:34 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:28:35 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root
Sep 28 18:28:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e1bf3a56-52f5-4c27-a8ec-1f72807c4d93 tempest-TestStampPattern-754072325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c" returned: 0 in 0.616s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:28:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e1bf3a56-52f5-4c27-a8ec-1f72807c4d93 tempest-TestStampPattern-754072325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:28:35 devstack sudo[107656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637
Sep 28 18:28:35 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:28:35 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root
Sep 28 18:28:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e1bf3a56-52f5-4c27-a8ec-1f72807c4d93 tempest-TestStampPattern-754072325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637" returned: 0 in 0.394s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:28:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e1bf3a56-52f5-4c27-a8ec-1f72807c4d93 tempest-TestStampPattern-754072325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:28:35 devstack sudo[107661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637
Sep 28 18:28:35 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:28:36 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root
Sep 28 18:28:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e1bf3a56-52f5-4c27-a8ec-1f72807c4d93 tempest-TestStampPattern-754072325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c.4bd1bfcd-c48f-4fcf-86af-9a01c9b89637" returned: 0 in 0.258s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:28:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e1bf3a56-52f5-4c27-a8ec-1f72807c4d93 tempest-TestStampPattern-754072325 None] Lock "cinder-quobyte-4bd1bfcd-c48f-4fcf-86af-9a01c9b89637" released by "_delete_snapshot" :: held 1.865s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:28:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e1bf3a56-52f5-4c27-a8ec-1f72807c4d93 tempest-TestStampPattern-754072325 None] Lock "cinder-quobyte-8b04cf48-6786-42db-a7c1-8510c84bde4c" released by "delete_snapshot" :: held 1.897s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:28:36 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-e1bf3a56-52f5-4c27-a8ec-1f72807c4d93 tempest-TestStampPattern-754072325 None] Created reservations ['bbca2748-862c-436c-b4a9-93fc3f3d32e6', 'd3c6ab60-6c3e-4db6-b985-521890a0792e', '3128ad9c-b78a-416f-9038-be9e33a537f0', '9711c690-1c28-4a60-b07a-0de545f67703'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:28:36 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-e1bf3a56-52f5-4c27-a8ec-1f72807c4d93 tempest-TestStampPattern-754072325 None] Delete snapshot completed successfully.
Sep 28 18:28:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e1bf3a56-52f5-4c27-a8ec-1f72807c4d93 tempest-TestStampPattern-754072325 None] Lock "cinder-4bd1bfcd-c48f-4fcf-86af-9a01c9b89637-delete_snapshot" released by "delete_snapshot" :: held 2.061s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:28:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:28:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:28:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:28:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:28:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:28:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:28:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:28:39 devstack sudo[107696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:28:39 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:28:39 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root
Sep 28 18:28:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.278s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:28:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:28:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:28:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:28:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:28:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-783cab36-3070-4619-8d09-cdfeeb5b44c0 tempest-TestStampPattern-754072325 None] Acquiring lock "cinder-8b04cf48-6786-42db-a7c1-8510c84bde4c-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:28:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-783cab36-3070-4619-8d09-cdfeeb5b44c0 tempest-TestStampPattern-754072325 None] Lock "cinder-8b04cf48-6786-42db-a7c1-8510c84bde4c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:28:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-783cab36-3070-4619-8d09-cdfeeb5b44c0 tempest-TestStampPattern-754072325 None] Acquiring lock "cinder-quobyte-8b04cf48-6786-42db-a7c1-8510c84bde4c" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:28:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-783cab36-3070-4619-8d09-cdfeeb5b44c0 tempest-TestStampPattern-754072325 None] Lock "cinder-quobyte-8b04cf48-6786-42db-a7c1-8510c84bde4c" acquired by "delete_volume" :: waited 0.018s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:28:40 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4997caf-2148-4b71-8a14-3f847edd50fa]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:28:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-783cab36-3070-4619-8d09-cdfeeb5b44c0 tempest-TestStampPattern-754072325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:28:40 devstack sudo[107699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c
Sep 28 18:28:40 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:28:40 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root
Sep 28 18:28:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-783cab36-3070-4619-8d09-cdfeeb5b44c0 tempest-TestStampPattern-754072325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c" returned: 0 in 0.472s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:28:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-783cab36-3070-4619-8d09-cdfeeb5b44c0 tempest-TestStampPattern-754072325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:28:41 devstack sudo[107704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c
Sep 28 18:28:41 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:28:41 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root
Sep 28 18:28:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-783cab36-3070-4619-8d09-cdfeeb5b44c0 tempest-TestStampPattern-754072325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8b04cf48-6786-42db-a7c1-8510c84bde4c" returned: 0 in 0.295s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:28:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-783cab36-3070-4619-8d09-cdfeeb5b44c0 tempest-TestStampPattern-754072325 None] Lock "cinder-quobyte-8b04cf48-6786-42db-a7c1-8510c84bde4c" released by "delete_volume" :: held 0.841s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:28:41 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-783cab36-3070-4619-8d09-cdfeeb5b44c0 tempest-TestStampPattern-754072325 None] Created reservations ['4c2c83b2-c4a0-4b01-9b81-a1ebe80cc00d', '8e290b99-d57c-48f8-8ba7-2d105ae54af4', 'e4c68b41-b21d-4bb7-9c34-7949b8bba820', 'e733fc27-7347-4c7d-b7ad-167d5dff0d39'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:28:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-783cab36-3070-4619-8d09-cdfeeb5b44c0 tempest-TestStampPattern-754072325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:28:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-783cab36-3070-4619-8d09-cdfeeb5b44c0 tempest-TestStampPattern-754072325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:28:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-783cab36-3070-4619-8d09-cdfeeb5b44c0 tempest-TestStampPattern-754072325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:28:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-783cab36-3070-4619-8d09-cdfeeb5b44c0 tempest-TestStampPattern-754072325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:28:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-783cab36-3070-4619-8d09-cdfeeb5b44c0 tempest-TestStampPattern-754072325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:28:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-783cab36-3070-4619-8d09-cdfeeb5b44c0 tempest-TestStampPattern-754072325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:28:41 devstack sudo[107707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:28:41 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:28:41 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root
Sep 28 18:28:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-783cab36-3070-4619-8d09-cdfeeb5b44c0 tempest-TestStampPattern-754072325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.293s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:28:41 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-783cab36-3070-4619-8d09-cdfeeb5b44c0 tempest-TestStampPattern-754072325 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:28:41 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-783cab36-3070-4619-8d09-cdfeeb5b44c0 tempest-TestStampPattern-754072325 None] Deleted volume successfully.
Sep 28 18:28:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-783cab36-3070-4619-8d09-cdfeeb5b44c0 tempest-TestStampPattern-754072325 None] Lock "cinder-8b04cf48-6786-42db-a7c1-8510c84bde4c-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:28:51 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=21,cinder:UPDATE=26,cinder:INSERT=7 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:28:51 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=25,cinder:UPDATE=20,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Flow 'volume_create_manager' (f5d1d2f8-b021-4e91-8432-4b490ae21a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5147dd4b-ab25-481d-8d25-492ef6f79db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5147dd4b-ab25-481d-8d25-492ef6f79db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-340196740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c80a801-f99e-4bcc-a2e7-2b14b55531c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214b23d1b40f4dfa8f90668d0efc69ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:55Z,use_quota=True,user_id='7802f4fea31d43fa931cc7fc1792d926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4e070e-011a-4e34-8a4f-2854536583dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4e070e-011a-4e34-8a4f-2854536583dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e07eb1-3464-4d4a-9732-c882c419accd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e07eb1-3464-4d4a-9732-c882c419accd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c80a801-f99e-4bcc-a2e7-2b14b55531c7', 'volume_name': 'volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884dbd99-a035-4c15-85d8-a38ffbc5a519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884dbd99-a035-4c15-85d8-a38ffbc5a519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5fe811-eb90-4451-b190-a3f1563246d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:28:55 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Volume 9c80a801-f99e-4bcc-a2e7-2b14b55531c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7', 'volume_size': 1}
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-340196740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c80a801-f99e-4bcc-a2e7-2b14b55531c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214b23d1b40f4dfa8f90668d0efc69ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:55Z,use_quota=True,user_id='7802f4fea31d43fa931cc7fc1792d926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Creating volume 9c80a801-f99e-4bcc-a2e7-2b14b55531c7 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:28:55 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:28:55 devstack sudo[107716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7 1073741824
Sep 28 18:28:55 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:28:55 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7 1073741824" returned: 0 in 0.404s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:28:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:28:55 devstack sudo[107721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7
Sep 28 18:28:55 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:28:56 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root
Sep 28 18:28:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7" returned: 0 in 0.247s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:28:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:28:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:28:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5fe811-eb90-4451-b190-a3f1563246d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:28:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5431e731-6840-4b9e-9312-4ba8f48bde5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:28:56 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Volume volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7 (9c80a801-f99e-4bcc-a2e7-2b14b55531c7): created successfully
Sep 28 18:28:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5431e731-6840-4b9e-9312-4ba8f48bde5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:28:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Flow 'volume_create_manager' (f5d1d2f8-b021-4e91-8432-4b490ae21a4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:28:56 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-bf5c8953-96bb-4e2a-8e24-bef7309a332d tempest-VolumeDependencyTests-507306569 None] Created volume successfully.
Sep 28 18:28:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f9e7912a-8d52-4078-9529-065cfaa041d7 tempest-VolumeDependencyTests-507306569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:28:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f9e7912a-8d52-4078-9529-065cfaa041d7 tempest-VolumeDependencyTests-507306569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:28:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-f9e7912a-8d52-4078-9529-065cfaa041d7 tempest-VolumeDependencyTests-507306569 None] Creating offline snapshot 18e3071c-5ec0-4e05-aeb9-c8ea3659d376 of volume 9c80a801-f99e-4bcc-a2e7-2b14b55531c7 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:28:56 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8c8ad8-ac7b-48d0-981a-f5e324b77f89]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:28:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f9e7912a-8d52-4078-9529-065cfaa041d7 tempest-VolumeDependencyTests-507306569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:28:56 devstack sudo[107724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7
Sep 28 18:28:56 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:28:56 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root
Sep 28 18:28:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f9e7912a-8d52-4078-9529-065cfaa041d7 tempest-VolumeDependencyTests-507306569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7" returned: 0 in 0.362s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:28:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f9e7912a-8d52-4078-9529-065cfaa041d7 tempest-VolumeDependencyTests-507306569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:28:56 devstack sudo[107729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376 1G
Sep 28 18:28:56 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:28:57 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root
Sep 28 18:28:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f9e7912a-8d52-4078-9529-065cfaa041d7 tempest-VolumeDependencyTests-507306569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376 1G" returned: 0 in 0.441s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:28:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f9e7912a-8d52-4078-9529-065cfaa041d7 tempest-VolumeDependencyTests-507306569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:28:57 devstack sudo[107734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376
Sep 28 18:28:57 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:28:57 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root
Sep 28 18:28:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f9e7912a-8d52-4078-9529-065cfaa041d7 tempest-VolumeDependencyTests-507306569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376" returned: 0 in 0.335s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:28:57 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-f9e7912a-8d52-4078-9529-065cfaa041d7 tempest-VolumeDependencyTests-507306569 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376 is being set with open permissions: ugo+rw
Sep 28 18:28:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f9e7912a-8d52-4078-9529-065cfaa041d7 tempest-VolumeDependencyTests-507306569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:28:57 devstack sudo[107739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376
Sep 28 18:28:57 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:28:57 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root
Sep 28 18:28:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f9e7912a-8d52-4078-9529-065cfaa041d7 tempest-VolumeDependencyTests-507306569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376" returned: 0 in 0.258s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:28:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f9e7912a-8d52-4078-9529-065cfaa041d7 tempest-VolumeDependencyTests-507306569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:28:57 devstack sudo[107742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.info
Sep 28 18:28:57 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:28:58 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root
Sep 28 18:28:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f9e7912a-8d52-4078-9529-065cfaa041d7 tempest-VolumeDependencyTests-507306569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.info" returned: 0 in 0.264s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:28:58 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-f9e7912a-8d52-4078-9529-065cfaa041d7 tempest-VolumeDependencyTests-507306569 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.info is being set with open permissions: ugo+rw
Sep 28 18:28:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f9e7912a-8d52-4078-9529-065cfaa041d7 tempest-VolumeDependencyTests-507306569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:28:58 devstack sudo[107745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.info
Sep 28 18:28:58 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:28:58 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root
Sep 28 18:28:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f9e7912a-8d52-4078-9529-065cfaa041d7 tempest-VolumeDependencyTests-507306569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.info" returned: 0 in 0.258s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:28:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f9e7912a-8d52-4078-9529-065cfaa041d7 tempest-VolumeDependencyTests-507306569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.021s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:28:58 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-f9e7912a-8d52-4078-9529-065cfaa041d7 tempest-VolumeDependencyTests-507306569 None] Create snapshot completed successfully
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Flow 'volume_create_manager' (7cefba6b-2775-4723-8a49-9a490dce0c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (721ea14b-a403-47a3-93d4-82de08a2698a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (721ea14b-a403-47a3-93d4-82de08a2698a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-605212514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af6fc274-9860-4677-bc1a-94ded8dd1e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214b23d1b40f4dfa8f90668d0efc69ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=18e3071c-5ec0-4e05-aeb9-c8ea3659d376,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:00Z,use_quota=True,user_id='7802f4fea31d43fa931cc7fc1792d926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f6ca5ce-5007-4e8b-b894-bccd51bfec39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f6ca5ce-5007-4e8b-b894-bccd51bfec39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (254ec310-6e67-49d0-9730-4539d28c6819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (254ec310-6e67-49d0-9730-4539d28c6819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'af6fc274-9860-4677-bc1a-94ded8dd1e34', 'volume_name': 'volume-af6fc274-9860-4677-bc1a-94ded8dd1e34', 'volume_size': 1, 'snapshot_id': '18e3071c-5ec0-4e05-aeb9-c8ea3659d376'}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e379cd57-804a-431d-ba38-beccec726f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e379cd57-804a-431d-ba38-beccec726f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dfe7fd5-e916-4084-a0bb-c92fdef1c856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:00 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Volume af6fc274-9860-4677-bc1a-94ded8dd1e34: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-af6fc274-9860-4677-bc1a-94ded8dd1e34', 'volume_size': 1, 'snapshot_id': '18e3071c-5ec0-4e05-aeb9-c8ea3659d376'}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Acquiring lock "cinder-quobyte-18e3071c-5ec0-4e05-aeb9-c8ea3659d376-af6fc274-9860-4677-bc1a-94ded8dd1e34" by "_create_volume_from_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Lock "cinder-quobyte-18e3071c-5ec0-4e05-aeb9-c8ea3659d376-af6fc274-9860-4677-bc1a-94ded8dd1e34" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Creating volume af6fc274-9860-4677-bc1a-94ded8dd1e34 from snapshot 18e3071c-5ec0-4e05-aeb9-c8ea3659d376 {{(pid=87046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Acquiring lock "cinder-quobyte-af6fc274-9860-4677-bc1a-94ded8dd1e34" by "_copy_volume_from_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Lock "cinder-quobyte-af6fc274-9860-4677-bc1a-94ded8dd1e34" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] snapshot: 18e3071c-5ec0-4e05-aeb9-c8ea3659d376, volume: af6fc274-9860-4677-bc1a-94ded8dd1e34,  {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f207706-c8e8-4ade-b0d1-6ed3721ad749]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:00 devstack sudo[107748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376
Sep 28 18:29:00 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:00 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376" returned: 0 in 0.375s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99c40c7-6730-4952-a186-9434b56b3aaa]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:00 devstack sudo[107754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7
Sep 28 18:29:00 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:01 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7" returned: 0 in 0.420s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7 {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 28 18:29:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Creating direct copy from snapshot {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 28 18:29:01 devstack cinder-volume[87046]: DEBUG cinder.utils [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Path /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af6fc274-9860-4677-bc1a-94ded8dd1e34 not found in is_blk_device check {{(pid=87046) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 28 18:29:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af6fc274-9860-4677-bc1a-94ded8dd1e34 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:01 devstack sudo[107759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af6fc274-9860-4677-bc1a-94ded8dd1e34
Sep 28 18:29:01 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:07 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af6fc274-9860-4677-bc1a-94ded8dd1e34" returned: 0 in 5.848s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:07 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Image conversion details: src /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af6fc274-9860-4677-bc1a-94ded8dd1e34 {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:29:07 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Converted 1024.00 MB image at 175.06 MB/s
Sep 28 18:29:07 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af6fc274-9860-4677-bc1a-94ded8dd1e34 is being set with open permissions: ugo+rw
Sep 28 18:29:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af6fc274-9860-4677-bc1a-94ded8dd1e34 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:07 devstack sudo[107779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af6fc274-9860-4677-bc1a-94ded8dd1e34
Sep 28 18:29:07 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:07 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af6fc274-9860-4677-bc1a-94ded8dd1e34" returned: 0 in 0.239s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Lock "cinder-quobyte-af6fc274-9860-4677-bc1a-94ded8dd1e34" released by "_copy_volume_from_snapshot" :: held 6.971s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Lock "cinder-quobyte-18e3071c-5ec0-4e05-aeb9-c8ea3659d376-af6fc274-9860-4677-bc1a-94ded8dd1e34" released by "_create_volume_from_snapshot" :: held 7.034s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.048s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dfe7fd5-e916-4084-a0bb-c92fdef1c856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af6fc274-9860-4677-bc1a-94ded8dd1e34', 'volume_size': 1, 'snapshot_id': '18e3071c-5ec0-4e05-aeb9-c8ea3659d376'}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47724b41-b5d3-4924-a44b-6e141db172a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:07 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Volume volume-af6fc274-9860-4677-bc1a-94ded8dd1e34 (af6fc274-9860-4677-bc1a-94ded8dd1e34): created successfully
Sep 28 18:29:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47724b41-b5d3-4924-a44b-6e141db172a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Flow 'volume_create_manager' (7cefba6b-2775-4723-8a49-9a490dce0c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:07 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-5b9d3b6a-a864-4db9-969e-d477d4ec848b tempest-VolumeDependencyTests-507306569 None] Created volume successfully.
Sep 28 18:29:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-467371ce-b53d-4052-9b69-f447713d98d4 tempest-VolumeDependencyTests-507306569 None] Acquiring lock "cinder-18e3071c-5ec0-4e05-aeb9-c8ea3659d376-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-467371ce-b53d-4052-9b69-f447713d98d4 tempest-VolumeDependencyTests-507306569 None] Lock "cinder-18e3071c-5ec0-4e05-aeb9-c8ea3659d376-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-467371ce-b53d-4052-9b69-f447713d98d4 tempest-VolumeDependencyTests-507306569 None] Acquiring lock "cinder-quobyte-9c80a801-f99e-4bcc-a2e7-2b14b55531c7" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-467371ce-b53d-4052-9b69-f447713d98d4 tempest-VolumeDependencyTests-507306569 None] Lock "cinder-quobyte-9c80a801-f99e-4bcc-a2e7-2b14b55531c7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-467371ce-b53d-4052-9b69-f447713d98d4 tempest-VolumeDependencyTests-507306569 None] Acquiring lock "cinder-quobyte-18e3071c-5ec0-4e05-aeb9-c8ea3659d376" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-467371ce-b53d-4052-9b69-f447713d98d4 tempest-VolumeDependencyTests-507306569 None] Lock "cinder-quobyte-18e3071c-5ec0-4e05-aeb9-c8ea3659d376" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:07 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-467371ce-b53d-4052-9b69-f447713d98d4 tempest-VolumeDependencyTests-507306569 None] Deleting offline snapshot 18e3071c-5ec0-4e05-aeb9-c8ea3659d376 of volume 9c80a801-f99e-4bcc-a2e7-2b14b55531c7 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:29:07 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-467371ce-b53d-4052-9b69-f447713d98d4 tempest-VolumeDependencyTests-507306569 None] snapshot_file for this snap is: volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:29:07 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9cb780-3ea4-4d1a-a271-a90bcdd94684]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-467371ce-b53d-4052-9b69-f447713d98d4 tempest-VolumeDependencyTests-507306569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:08 devstack sudo[107782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376
Sep 28 18:29:08 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:08 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-467371ce-b53d-4052-9b69-f447713d98d4 tempest-VolumeDependencyTests-507306569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376" returned: 0 in 0.417s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-467371ce-b53d-4052-9b69-f447713d98d4 tempest-VolumeDependencyTests-507306569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:29:08 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dae060-c2b1-460e-a460-9071cf7d3c82]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-467371ce-b53d-4052-9b69-f447713d98d4 tempest-VolumeDependencyTests-507306569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:08 devstack sudo[107787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7
Sep 28 18:29:08 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:08 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-467371ce-b53d-4052-9b69-f447713d98d4 tempest-VolumeDependencyTests-507306569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7" returned: 0 in 0.606s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-467371ce-b53d-4052-9b69-f447713d98d4 tempest-VolumeDependencyTests-507306569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:08 devstack sudo[107792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376
Sep 28 18:29:08 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:09 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-467371ce-b53d-4052-9b69-f447713d98d4 tempest-VolumeDependencyTests-507306569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376" returned: 0 in 0.405s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-467371ce-b53d-4052-9b69-f447713d98d4 tempest-VolumeDependencyTests-507306569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:09 devstack sudo[107798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376
Sep 28 18:29:09 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:09 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-467371ce-b53d-4052-9b69-f447713d98d4 tempest-VolumeDependencyTests-507306569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7.18e3071c-5ec0-4e05-aeb9-c8ea3659d376" returned: 0 in 0.263s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-467371ce-b53d-4052-9b69-f447713d98d4 tempest-VolumeDependencyTests-507306569 None] Lock "cinder-quobyte-18e3071c-5ec0-4e05-aeb9-c8ea3659d376" released by "_delete_snapshot" :: held 1.817s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-467371ce-b53d-4052-9b69-f447713d98d4 tempest-VolumeDependencyTests-507306569 None] Lock "cinder-quobyte-9c80a801-f99e-4bcc-a2e7-2b14b55531c7" released by "delete_snapshot" :: held 1.844s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:09 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-467371ce-b53d-4052-9b69-f447713d98d4 tempest-VolumeDependencyTests-507306569 None] Created reservations ['b8d6aedd-b552-4df3-92cb-cf3a4f86cf31', '4a08210e-1887-401b-8233-cbee41793d83', '1320380d-b553-4e4d-be95-1b860846a822', '7475f96c-daa2-4c60-aebb-38e1be85bbc8'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:29:09 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-467371ce-b53d-4052-9b69-f447713d98d4 tempest-VolumeDependencyTests-507306569 None] Delete snapshot completed successfully.
Sep 28 18:29:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-467371ce-b53d-4052-9b69-f447713d98d4 tempest-VolumeDependencyTests-507306569 None] Lock "cinder-18e3071c-5ec0-4e05-aeb9-c8ea3659d376-delete_snapshot" released by "delete_snapshot" :: held 1.993s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-db7530cb-3b15-4934-bab3-e05961fe4f40 tempest-VolumeDependencyTests-507306569 None] Acquiring lock "cinder-9c80a801-f99e-4bcc-a2e7-2b14b55531c7-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-db7530cb-3b15-4934-bab3-e05961fe4f40 tempest-VolumeDependencyTests-507306569 None] Lock "cinder-9c80a801-f99e-4bcc-a2e7-2b14b55531c7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:10 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-db7530cb-3b15-4934-bab3-e05961fe4f40 tempest-VolumeDependencyTests-507306569 None] Acquiring lock "cinder-quobyte-9c80a801-f99e-4bcc-a2e7-2b14b55531c7" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:10 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-db7530cb-3b15-4934-bab3-e05961fe4f40 tempest-VolumeDependencyTests-507306569 None] Lock "cinder-quobyte-9c80a801-f99e-4bcc-a2e7-2b14b55531c7" acquired by "delete_volume" :: waited 0.017s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:10 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8022ba0-245c-4dd8-a3d7-b56637ebd471]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-db7530cb-3b15-4934-bab3-e05961fe4f40 tempest-VolumeDependencyTests-507306569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:10 devstack sudo[107801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7
Sep 28 18:29:10 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:10 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-db7530cb-3b15-4934-bab3-e05961fe4f40 tempest-VolumeDependencyTests-507306569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7" returned: 0 in 0.439s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-db7530cb-3b15-4934-bab3-e05961fe4f40 tempest-VolumeDependencyTests-507306569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:10 devstack sudo[107806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7
Sep 28 18:29:10 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:10 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-db7530cb-3b15-4934-bab3-e05961fe4f40 tempest-VolumeDependencyTests-507306569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9c80a801-f99e-4bcc-a2e7-2b14b55531c7" returned: 0 in 0.306s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:10 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-db7530cb-3b15-4934-bab3-e05961fe4f40 tempest-VolumeDependencyTests-507306569 None] Lock "cinder-quobyte-9c80a801-f99e-4bcc-a2e7-2b14b55531c7" released by "delete_volume" :: held 0.812s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:10 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-db7530cb-3b15-4934-bab3-e05961fe4f40 tempest-VolumeDependencyTests-507306569 None] Created reservations ['ee04f915-5463-4964-8769-0e375268cf53', '4e0b7301-5f70-4c8f-ac36-cafb93932ce8', 'a591e219-c10f-4d8f-a2eb-8d3882e03bbd', '2b1251ab-4d97-4b95-9b24-edb8f1aa159e'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:29:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-db7530cb-3b15-4934-bab3-e05961fe4f40 tempest-VolumeDependencyTests-507306569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-db7530cb-3b15-4934-bab3-e05961fe4f40 tempest-VolumeDependencyTests-507306569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:10 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-db7530cb-3b15-4934-bab3-e05961fe4f40 tempest-VolumeDependencyTests-507306569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:11 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-db7530cb-3b15-4934-bab3-e05961fe4f40 tempest-VolumeDependencyTests-507306569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-db7530cb-3b15-4934-bab3-e05961fe4f40 tempest-VolumeDependencyTests-507306569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-db7530cb-3b15-4934-bab3-e05961fe4f40 tempest-VolumeDependencyTests-507306569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:11 devstack sudo[107809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:29:11 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e3672f32-3f19-4bf9-a377-0e8027b91b15 tempest-VolumeDependencyTests-507306569 None] Acquiring lock "cinder-af6fc274-9860-4677-bc1a-94ded8dd1e34-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e3672f32-3f19-4bf9-a377-0e8027b91b15 tempest-VolumeDependencyTests-507306569 None] Lock "cinder-af6fc274-9860-4677-bc1a-94ded8dd1e34-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e3672f32-3f19-4bf9-a377-0e8027b91b15 tempest-VolumeDependencyTests-507306569 None] Acquiring lock "cinder-quobyte-af6fc274-9860-4677-bc1a-94ded8dd1e34" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e3672f32-3f19-4bf9-a377-0e8027b91b15 tempest-VolumeDependencyTests-507306569 None] Lock "cinder-quobyte-af6fc274-9860-4677-bc1a-94ded8dd1e34" acquired by "delete_volume" :: waited 0.019s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:11 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[623e419d-f156-4a01-a4a3-29ee4e908add]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e3672f32-3f19-4bf9-a377-0e8027b91b15 tempest-VolumeDependencyTests-507306569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af6fc274-9860-4677-bc1a-94ded8dd1e34 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:11 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-db7530cb-3b15-4934-bab3-e05961fe4f40 tempest-VolumeDependencyTests-507306569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.308s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:11 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-db7530cb-3b15-4934-bab3-e05961fe4f40 tempest-VolumeDependencyTests-507306569 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:29:11 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-db7530cb-3b15-4934-bab3-e05961fe4f40 tempest-VolumeDependencyTests-507306569 None] Deleted volume successfully.
Sep 28 18:29:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-db7530cb-3b15-4934-bab3-e05961fe4f40 tempest-VolumeDependencyTests-507306569 None] Lock "cinder-9c80a801-f99e-4bcc-a2e7-2b14b55531c7-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:11 devstack sudo[107812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af6fc274-9860-4677-bc1a-94ded8dd1e34
Sep 28 18:29:11 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:11 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e3672f32-3f19-4bf9-a377-0e8027b91b15 tempest-VolumeDependencyTests-507306569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af6fc274-9860-4677-bc1a-94ded8dd1e34" returned: 0 in 0.431s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e3672f32-3f19-4bf9-a377-0e8027b91b15 tempest-VolumeDependencyTests-507306569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af6fc274-9860-4677-bc1a-94ded8dd1e34 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:11 devstack sudo[107817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af6fc274-9860-4677-bc1a-94ded8dd1e34
Sep 28 18:29:11 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:12 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e3672f32-3f19-4bf9-a377-0e8027b91b15 tempest-VolumeDependencyTests-507306569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af6fc274-9860-4677-bc1a-94ded8dd1e34" returned: 0 in 0.283s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:12 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e3672f32-3f19-4bf9-a377-0e8027b91b15 tempest-VolumeDependencyTests-507306569 None] Lock "cinder-quobyte-af6fc274-9860-4677-bc1a-94ded8dd1e34" released by "delete_volume" :: held 0.766s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:12 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-e3672f32-3f19-4bf9-a377-0e8027b91b15 tempest-VolumeDependencyTests-507306569 None] Created reservations ['c829f3ae-94f6-45b1-9720-98f2cd7f53ed', '0a6c71fb-159d-42a9-889c-01e80a8cf949', '87831003-443c-4e5c-8c2e-8e104d37a27a', '2bea8fb9-bf94-43a1-a136-92f55f64de1f'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:29:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e3672f32-3f19-4bf9-a377-0e8027b91b15 tempest-VolumeDependencyTests-507306569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e3672f32-3f19-4bf9-a377-0e8027b91b15 tempest-VolumeDependencyTests-507306569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e3672f32-3f19-4bf9-a377-0e8027b91b15 tempest-VolumeDependencyTests-507306569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:12 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e3672f32-3f19-4bf9-a377-0e8027b91b15 tempest-VolumeDependencyTests-507306569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e3672f32-3f19-4bf9-a377-0e8027b91b15 tempest-VolumeDependencyTests-507306569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e3672f32-3f19-4bf9-a377-0e8027b91b15 tempest-VolumeDependencyTests-507306569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:12 devstack sudo[107820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:29:12 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:12 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e3672f32-3f19-4bf9-a377-0e8027b91b15 tempest-VolumeDependencyTests-507306569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.310s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:12 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-e3672f32-3f19-4bf9-a377-0e8027b91b15 tempest-VolumeDependencyTests-507306569 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:29:12 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-e3672f32-3f19-4bf9-a377-0e8027b91b15 tempest-VolumeDependencyTests-507306569 None] Deleted volume successfully.
Sep 28 18:29:12 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e3672f32-3f19-4bf9-a377-0e8027b91b15 tempest-VolumeDependencyTests-507306569 None] Lock "cinder-af6fc274-9860-4677-bc1a-94ded8dd1e34-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:22 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=26,cinder:INSERT=9,cinder:UPDATE=28,cinder:DELETE=2 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:29:22 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:UPDATE=31,cinder:SELECT=24,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Flow 'volume_create_manager' (d4bfc93f-57ec-4c0c-b686-16aa821ad317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eaff062-4680-4d1e-813b-879b05fb96c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eaff062-4680-4d1e-813b-879b05fb96c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1132323239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92cb2313-8118-4a01-b584-2a98f3ba8beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091d430ce724412eaa757fad2046fb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:26Z,use_quota=True,user_id='2401de6e9014424fa25fc2818265882b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a832a0-3531-4264-a007-5fa0c3b1cc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a832a0-3531-4264-a007-5fa0c3b1cc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a26261-4165-4f6e-914a-bae589ca30e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a26261-4165-4f6e-914a-bae589ca30e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92cb2313-8118-4a01-b584-2a98f3ba8beb', 'volume_name': 'volume-92cb2313-8118-4a01-b584-2a98f3ba8beb', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fc2772-751c-41c8-8f94-0936eab1ca9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fc2772-751c-41c8-8f94-0936eab1ca9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2108b5d8-4c4c-4c13-8b42-ccc6e8b15cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:26 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Volume 92cb2313-8118-4a01-b584-2a98f3ba8beb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92cb2313-8118-4a01-b584-2a98f3ba8beb', 'volume_size': 1}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1132323239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92cb2313-8118-4a01-b584-2a98f3ba8beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091d430ce724412eaa757fad2046fb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:26Z,use_quota=True,user_id='2401de6e9014424fa25fc2818265882b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Creating volume 92cb2313-8118-4a01-b584-2a98f3ba8beb {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:29:26 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-92cb2313-8118-4a01-b584-2a98f3ba8beb 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:26 devstack sudo[107867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-92cb2313-8118-4a01-b584-2a98f3ba8beb 1073741824
Sep 28 18:29:26 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Flow 'volume_create_manager' (e43430e9-68f1-4016-bb6c-50c8f5552e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367c0aed-e9a2-44da-8f06-38ac5fd02da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367c0aed-e9a2-44da-8f06-38ac5fd02da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da44a27-42a8-4d35-950d-c7ea86482c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='941686dd27784ffe885e0ad2b8c0dd1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:27Z,use_quota=True,user_id='0d1836cff6f64dc9a8273ff25640e8d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709a059a-e6f1-4792-8bf0-c196a39b8c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709a059a-e6f1-4792-8bf0-c196a39b8c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d240bc-7b4e-4e73-82a7-6146ce9b6a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d240bc-7b4e-4e73-82a7-6146ce9b6a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0da44a27-42a8-4d35-950d-c7ea86482c2d', 'volume_name': 'volume-0da44a27-42a8-4d35-950d-c7ea86482c2d', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4cad221-8d41-4e64-ac1e-023a355831cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4cad221-8d41-4e64-ac1e-023a355831cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d256b1ed-1070-4c22-9d23-093ae8458acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:26 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Volume 0da44a27-42a8-4d35-950d-c7ea86482c2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0da44a27-42a8-4d35-950d-c7ea86482c2d', 'volume_size': 1}
Sep 28 18:29:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Flow 'volume_create_manager' (7b209047-7a75-4425-b10e-1a81d927f2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a982b86-9990-4b19-ae74-1840e89dbcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a982b86-9990-4b19-ae74-1840e89dbcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1753978357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d94c11-050b-4907-8701-e983013c93a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091d430ce724412eaa757fad2046fb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:27Z,use_quota=True,user_id='2401de6e9014424fa25fc2818265882b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2ac05b-ed95-479a-aeb9-077ba802a23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2ac05b-ed95-479a-aeb9-077ba802a23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb172f1-83a2-4b55-9fa4-110887bf3978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb172f1-83a2-4b55-9fa4-110887bf3978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9d94c11-050b-4907-8701-e983013c93a8', 'volume_name': 'volume-a9d94c11-050b-4907-8701-e983013c93a8', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7e70db-8535-46c2-aef3-173332b22667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7e70db-8535-46c2-aef3-173332b22667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136783c4-4ada-436e-a6a2-09cc71099e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:27 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Volume a9d94c11-050b-4907-8701-e983013c93a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9d94c11-050b-4907-8701-e983013c93a8', 'volume_size': 1}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:27 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-92cb2313-8118-4a01-b584-2a98f3ba8beb 1073741824" returned: 0 in 0.791s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Flow 'volume_create_manager' (b087ecaa-48d6-4d37-89f8-9af6f7ec8cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a06c29d5-df4f-4da2-9a68-d06b5611eaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a06c29d5-df4f-4da2-9a68-d06b5611eaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1775719955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8e6e8a-2a7a-4259-9e2d-38a3605535d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeb3f91dba041cf90cb0a77d65f7462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:27Z,use_quota=True,user_id='8b662392cce94af1afbb63c334c54a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622f3087-1403-46f2-8b91-ef8584223255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622f3087-1403-46f2-8b91-ef8584223255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da61def6-912f-44e9-bbde-b751f2c5b06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da61def6-912f-44e9-bbde-b751f2c5b06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b8e6e8a-2a7a-4259-9e2d-38a3605535d4', 'volume_name': 'volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd97630-cade-4947-9dee-dca7b52c73be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd97630-cade-4947-9dee-dca7b52c73be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e5b04a-6e7a-4d1a-88e9-6d5c409c814b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:27 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Volume 1b8e6e8a-2a7a-4259-9e2d-38a3605535d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4', 'volume_size': 1}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-92cb2313-8118-4a01-b584-2a98f3ba8beb {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:27 devstack sudo[107873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-92cb2313-8118-4a01-b584-2a98f3ba8beb
Sep 28 18:29:27 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Flow 'volume_create_manager' (8690b74d-1d59-4ea4-a398-a3245061256e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c57fb1fc-953b-4b3a-a0dd-1010819d7412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c57fb1fc-953b-4b3a-a0dd-1010819d7412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-966919602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3324328b-435d-4fd5-82fa-d9ad15471939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091d430ce724412eaa757fad2046fb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:28Z,use_quota=True,user_id='2401de6e9014424fa25fc2818265882b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43381dec-5afc-4a10-b1e1-46a67d7a56ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43381dec-5afc-4a10-b1e1-46a67d7a56ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907622d8-0641-4136-9124-cc584e9c0f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907622d8-0641-4136-9124-cc584e9c0f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3324328b-435d-4fd5-82fa-d9ad15471939', 'volume_name': 'volume-3324328b-435d-4fd5-82fa-d9ad15471939', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2afff41f-e098-4ffd-835a-f4713a8c1d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2afff41f-e098-4ffd-835a-f4713a8c1d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dab41f4-7304-46e4-941c-ce472b2fbf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:27 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Volume 3324328b-435d-4fd5-82fa-d9ad15471939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3324328b-435d-4fd5-82fa-d9ad15471939', 'volume_size': 1}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:27 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-92cb2313-8118-4a01-b584-2a98f3ba8beb" returned: 0 in 0.333s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.080s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da44a27-42a8-4d35-950d-c7ea86482c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='941686dd27784ffe885e0ad2b8c0dd1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:27Z,use_quota=True,user_id='0d1836cff6f64dc9a8273ff25640e8d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Creating volume 0da44a27-42a8-4d35-950d-c7ea86482c2d {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:29:28 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0da44a27-42a8-4d35-950d-c7ea86482c2d 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2108b5d8-4c4c-4c13-8b42-ccc6e8b15cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92cb2313-8118-4a01-b584-2a98f3ba8beb', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d7e7150-cd61-4781-a32b-5784341bc2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:28 devstack sudo[107876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0da44a27-42a8-4d35-950d-c7ea86482c2d 1073741824
Sep 28 18:29:28 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:28 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Volume volume-92cb2313-8118-4a01-b584-2a98f3ba8beb (92cb2313-8118-4a01-b584-2a98f3ba8beb): created successfully
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d7e7150-cd61-4781-a32b-5784341bc2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Flow 'volume_create_manager' (d4bfc93f-57ec-4c0c-b686-16aa821ad317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:28 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-9b2744c8-75dd-482e-a6e5-30521fbf2088 tempest-CreateVolumesFromImageTest-1599051730 None] Created volume successfully.
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Flow 'volume_create_manager' (dc03a0ce-0e9b-4fcb-aa35-4f07c1214556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec91eba8-5a2f-4d0e-abe7-687341339a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec91eba8-5a2f-4d0e-abe7-687341339a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1797773880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9fc3d3-55b0-4ec3-9573-f76a864ef045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091d430ce724412eaa757fad2046fb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:28Z,use_quota=True,user_id='2401de6e9014424fa25fc2818265882b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc1dd15-e659-4233-8a2d-734d282446e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc1dd15-e659-4233-8a2d-734d282446e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe45e2b-f6b3-4a03-b8b4-0c172afc93e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe45e2b-f6b3-4a03-b8b4-0c172afc93e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f9fc3d3-55b0-4ec3-9573-f76a864ef045', 'volume_name': 'volume-9f9fc3d3-55b0-4ec3-9573-f76a864ef045', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8543635e-0680-49e1-a705-06f2ce71ef93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8543635e-0680-49e1-a705-06f2ce71ef93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff3dc77-65d2-4a74-a90c-10964d825f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:28 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Volume 9f9fc3d3-55b0-4ec3-9573-f76a864ef045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f9fc3d3-55b0-4ec3-9573-f76a864ef045', 'volume_size': 1}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:28 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0da44a27-42a8-4d35-950d-c7ea86482c2d 1073741824" returned: 0 in 0.674s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0da44a27-42a8-4d35-950d-c7ea86482c2d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:28 devstack sudo[107882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0da44a27-42a8-4d35-950d-c7ea86482c2d
Sep 28 18:29:28 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Flow 'volume_create_manager' (b6e80e16-72d8-45ef-a195-02c1276444bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d18bcc0-17d3-46b9-9471-8050eb31d9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d18bcc0-17d3-46b9-9471-8050eb31d9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-878552422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff95084-2e89-4356-9c6e-298e7ec992f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091d430ce724412eaa757fad2046fb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:29Z,use_quota=True,user_id='2401de6e9014424fa25fc2818265882b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20300349-9abb-4e6d-a76e-91127ec14f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20300349-9abb-4e6d-a76e-91127ec14f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ad74de-85de-473b-8289-93cdeaa8d19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ad74de-85de-473b-8289-93cdeaa8d19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ff95084-2e89-4356-9c6e-298e7ec992f4', 'volume_name': 'volume-9ff95084-2e89-4356-9c6e-298e7ec992f4', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6baace1-85e7-499b-a313-a5c2bb6d4736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6baace1-85e7-499b-a313-a5c2bb6d4736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591b8bf8-367a-4e72-9134-32b3af1fcf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:28 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Volume 9ff95084-2e89-4356-9c6e-298e7ec992f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ff95084-2e89-4356-9c6e-298e7ec992f4', 'volume_size': 1}
Sep 28 18:29:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:29 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0da44a27-42a8-4d35-950d-c7ea86482c2d" returned: 0 in 0.323s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.683s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1753978357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d94c11-050b-4907-8701-e983013c93a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091d430ce724412eaa757fad2046fb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:27Z,use_quota=True,user_id='2401de6e9014424fa25fc2818265882b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Creating volume a9d94c11-050b-4907-8701-e983013c93a8 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:29:29 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a9d94c11-050b-4907-8701-e983013c93a8 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d256b1ed-1070-4c22-9d23-093ae8458acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0da44a27-42a8-4d35-950d-c7ea86482c2d', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:29 devstack sudo[107885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a9d94c11-050b-4907-8701-e983013c93a8 1073741824
Sep 28 18:29:29 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6dca45b-2d9e-4489-8439-e85622dbd099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:29 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Volume volume-0da44a27-42a8-4d35-950d-c7ea86482c2d (0da44a27-42a8-4d35-950d-c7ea86482c2d): created successfully
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6dca45b-2d9e-4489-8439-e85622dbd099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Flow 'volume_create_manager' (e43430e9-68f1-4016-bb6c-50c8f5552e10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:29 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-9bd086c9-8a2d-49e9-9d6d-034421b529c2 tempest-CinderUnicodeTest-851630309 None] Created volume successfully.
Sep 28 18:29:29 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a9d94c11-050b-4907-8701-e983013c93a8 1073741824" returned: 0 in 0.587s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a9d94c11-050b-4907-8701-e983013c93a8 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:29 devstack sudo[107891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a9d94c11-050b-4907-8701-e983013c93a8
Sep 28 18:29:29 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:29 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a9d94c11-050b-4907-8701-e983013c93a8" returned: 0 in 0.278s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.332s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1775719955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8e6e8a-2a7a-4259-9e2d-38a3605535d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeb3f91dba041cf90cb0a77d65f7462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:27Z,use_quota=True,user_id='8b662392cce94af1afbb63c334c54a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Creating volume 1b8e6e8a-2a7a-4259-9e2d-38a3605535d4 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:29:29 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:29:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136783c4-4ada-436e-a6a2-09cc71099e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9d94c11-050b-4907-8701-e983013c93a8', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:30 devstack sudo[107894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4 1073741824
Sep 28 18:29:30 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5443888d-7e25-4b60-8143-ab7e190b2539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:30 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Volume volume-a9d94c11-050b-4907-8701-e983013c93a8 (a9d94c11-050b-4907-8701-e983013c93a8): created successfully
Sep 28 18:29:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5443888d-7e25-4b60-8143-ab7e190b2539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Flow 'volume_create_manager' (7b209047-7a75-4425-b10e-1a81d927f2c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:30 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-48126a72-6c9b-4705-9d7a-2aa87b336d26 tempest-CreateVolumesFromImageTest-1599051730 None] Created volume successfully.
Sep 28 18:29:30 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4 1073741824" returned: 0 in 0.603s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:30 devstack sudo[107901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4
Sep 28 18:29:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:30 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:31 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4" returned: 0 in 0.374s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.132s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-966919602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3324328b-435d-4fd5-82fa-d9ad15471939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091d430ce724412eaa757fad2046fb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:28Z,use_quota=True,user_id='2401de6e9014424fa25fc2818265882b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Creating volume 3324328b-435d-4fd5-82fa-d9ad15471939 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:29:31 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3324328b-435d-4fd5-82fa-d9ad15471939 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e5b04a-6e7a-4d1a-88e9-6d5c409c814b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e78d0314-49e4-496d-a358-c74fa04dbf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:31 devstack sudo[107905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3324328b-435d-4fd5-82fa-d9ad15471939 1073741824
Sep 28 18:29:31 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:31 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Volume volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4 (1b8e6e8a-2a7a-4259-9e2d-38a3605535d4): created successfully
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e78d0314-49e4-496d-a358-c74fa04dbf14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Flow 'volume_create_manager' (b087ecaa-48d6-4d37-89f8-9af6f7ec8cac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Flow 'volume_create_manager' (9873bb1c-7736-4b3c-a453-61a286bf41a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdaaeeb-f765-4ca0-be68-a4348b16e40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdaaeeb-f765-4ca0-be68-a4348b16e40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1214258203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dafb08a-daa6-444d-9535-dcd835adafec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='941686dd27784ffe885e0ad2b8c0dd1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:31Z,use_quota=True,user_id='0d1836cff6f64dc9a8273ff25640e8d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf5232eb-0150-4af3-94af-db7a7aebf976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf5232eb-0150-4af3-94af-db7a7aebf976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (130d610d-a6d4-4e9c-9478-c2dd19ca75f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (130d610d-a6d4-4e9c-9478-c2dd19ca75f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dafb08a-daa6-444d-9535-dcd835adafec', 'volume_name': 'volume-1dafb08a-daa6-444d-9535-dcd835adafec', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1a5fa6-1f52-4d23-9963-3d5d43f0a863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1a5fa6-1f52-4d23-9963-3d5d43f0a863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2ace75-1564-4c20-a9ea-27edd0a60c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:31 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Volume 1dafb08a-daa6-444d-9535-dcd835adafec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dafb08a-daa6-444d-9535-dcd835adafec', 'volume_size': 1}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:31 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-ed479714-ef52-4640-b26d-c2bd08dc73d6 tempest-CreateVolumesFromSnapshotTest-859314465 None] Created volume successfully.
Sep 28 18:29:31 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3324328b-435d-4fd5-82fa-d9ad15471939 1073741824" returned: 0 in 0.703s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Flow 'volume_create_manager' (a47b002f-ca8a-4124-9658-328d4a57bac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a5c70e-79ff-400b-b043-47cc45513c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3324328b-435d-4fd5-82fa-d9ad15471939 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:31 devstack sudo[107911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3324328b-435d-4fd5-82fa-d9ad15471939
Sep 28 18:29:31 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a5c70e-79ff-400b-b043-47cc45513c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98223190-7b9e-42d8-bf0d-74c5fd45089d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8ff197da8c54e519e5c9125b4624277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:32Z,use_quota=True,user_id='16ad8e4e27e242bf8d87cc61919f4830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33687111-8171-4f95-a9e0-f8b518ba04b3),volume_type_id=33687111-8171-4f95-a9e0-f8b518ba04b3)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6902b446-8b1b-4817-ad9d-dd63530b743a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6902b446-8b1b-4817-ad9d-dd63530b743a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08447196-78f3-4ffe-8e90-fba671404795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG cinder.image.glance [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Creating Keystone auth plugin from conf {{(pid=87046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 28 18:29:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-4eb1d971-ae01-4b05-b0c9-a9948a01d6b2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:32 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3324328b-435d-4fd5-82fa-d9ad15471939" returned: 0 in 0.347s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.716s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1797773880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9fc3d3-55b0-4ec3-9573-f76a864ef045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091d430ce724412eaa757fad2046fb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:28Z,use_quota=True,user_id='2401de6e9014424fa25fc2818265882b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Creating volume 9f9fc3d3-55b0-4ec3-9573-f76a864ef045 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:29:32 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9f9fc3d3-55b0-4ec3-9573-f76a864ef045 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:32 devstack sudo[107914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9f9fc3d3-55b0-4ec3-9573-f76a864ef045 1073741824
Sep 28 18:29:32 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dab41f4-7304-46e4-941c-ce472b2fbf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3324328b-435d-4fd5-82fa-d9ad15471939', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06a76c1-41fb-463d-93a5-6ebdbdc0aca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:32 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Volume volume-3324328b-435d-4fd5-82fa-d9ad15471939 (3324328b-435d-4fd5-82fa-d9ad15471939): created successfully
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06a76c1-41fb-463d-93a5-6ebdbdc0aca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Flow 'volume_create_manager' (8690b74d-1d59-4ea4-a398-a3245061256e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08447196-78f3-4ffe-8e90-fba671404795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '98223190-7b9e-42d8-bf0d-74c5fd45089d', 'volume_name': 'volume-98223190-7b9e-42d8-bf0d-74c5fd45089d', 'volume_size': 1, 'image_id': 'd644095a-57ba-4142-8962-a8804fc8ee08', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d644095a-57ba-4142-8962-a8804fc8ee08', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6c1000349b5da314d2707551b3303497', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b8ff197da8c54e519e5c9125b4624277', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9f2c9ebdcc0a47b7e3802019fcd5c198067c64509b332c286edd027647c774a2f2786ba084ec15bbcfa81f78b72063d767baf3015960ebccd1547304eb217976', 'id': 'd644095a-57ba-4142-8962-a8804fc8ee08', 'created_at': datetime.datetime(2026, 9, 28, 16, 29, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 29, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d644095a-57ba-4142-8962-a8804fc8ee08/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aaee8af90>}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff0221c-848e-4619-9a2b-0995b57e9aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff0221c-848e-4619-9a2b-0995b57e9aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69712b97-3708-4b8b-9fd9-e3b03db6c8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:32 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Volume 98223190-7b9e-42d8-bf0d-74c5fd45089d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-98223190-7b9e-42d8-bf0d-74c5fd45089d', 'volume_size': 1, 'image_id': 'd644095a-57ba-4142-8962-a8804fc8ee08', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d644095a-57ba-4142-8962-a8804fc8ee08', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6c1000349b5da314d2707551b3303497', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b8ff197da8c54e519e5c9125b4624277', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9f2c9ebdcc0a47b7e3802019fcd5c198067c64509b332c286edd027647c774a2f2786ba084ec15bbcfa81f78b72063d767baf3015960ebccd1547304eb217976', 'id': 'd644095a-57ba-4142-8962-a8804fc8ee08', 'created_at': datetime.datetime(2026, 9, 28, 16, 29, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 29, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d644095a-57ba-4142-8962-a8804fc8ee08/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aaee8af90>}
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Trying to clone 98223190-7b9e-42d8-bf0d-74c5fd45089d from image d644095a-57ba-4142-8962-a8804fc8ee08 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d644095a-57ba-4142-8962-a8804fc8ee08', 'metadata': {}}]). {{(pid=87046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 28 18:29:32 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-599fd7d8-ccc9-49cd-a074-50025b36998b tempest-CreateVolumesFromImageTest-1599051730 None] Created volume successfully.
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 28 18:29:32 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Image download 0.00 MB at 0.00 MB/s
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48a242a-5bde-47ec-bff4-10c7025138c7]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:32 devstack sudo[107919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD
Sep 28 18:29:32 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:32 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9f9fc3d3-55b0-4ec3-9573-f76a864ef045 1073741824" returned: 0 in 0.490s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9f9fc3d3-55b0-4ec3-9573-f76a864ef045 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:32 devstack sudo[107922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9f9fc3d3-55b0-4ec3-9573-f76a864ef045
Sep 28 18:29:32 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:32 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:32 devstack sudo[107926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD
Sep 28 18:29:32 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:33 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9f9fc3d3-55b0-4ec3-9573-f76a864ef045" returned: 0 in 0.327s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.183s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-878552422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff95084-2e89-4356-9c6e-298e7ec992f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091d430ce724412eaa757fad2046fb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:29Z,use_quota=True,user_id='2401de6e9014424fa25fc2818265882b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Creating volume 9ff95084-2e89-4356-9c6e-298e7ec992f4 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:29:33 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff95084-2e89-4356-9c6e-298e7ec992f4 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff3dc77-65d2-4a74-a90c-10964d825f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f9fc3d3-55b0-4ec3-9573-f76a864ef045', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:33 devstack sudo[107929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff95084-2e89-4356-9c6e-298e7ec992f4 1073741824
Sep 28 18:29:33 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd2056a-f49e-41f5-8ab0-0368e4afb68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:33 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Volume volume-9f9fc3d3-55b0-4ec3-9573-f76a864ef045 (9f9fc3d3-55b0-4ec3-9573-f76a864ef045): created successfully
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd2056a-f49e-41f5-8ab0-0368e4afb68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Flow 'volume_create_manager' (dc03a0ce-0e9b-4fcb-aa35-4f07c1214556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:33 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-c913b182-f3bf-41e9-bd2b-f511ad6c89f8 tempest-CreateVolumesFromImageTest-1599051730 None] Created volume successfully.
Sep 28 18:29:33 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD" returned: 1 in 0.410s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Temporary image d644095a-57ba-4142-8962-a8804fc8ee08 is fetched for user 16ad8e4e27e242bf8d87cc61919f4830. {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[eceb89db-f242-4caf-b488-9d73c48b8cf5]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:33 devstack sudo[107937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD
Sep 28 18:29:33 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:33 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff95084-2e89-4356-9c6e-298e7ec992f4 1073741824" returned: 0 in 0.515s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff95084-2e89-4356-9c6e-298e7ec992f4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:33 devstack sudo[107941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff95084-2e89-4356-9c6e-298e7ec992f4
Sep 28 18:29:33 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:33 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:33 devstack sudo[107945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD
Sep 28 18:29:33 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:33 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff95084-2e89-4356-9c6e-298e7ec992f4" returned: 0 in 0.316s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.706s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1214258203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dafb08a-daa6-444d-9535-dcd835adafec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='941686dd27784ffe885e0ad2b8c0dd1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:31Z,use_quota=True,user_id='0d1836cff6f64dc9a8273ff25640e8d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Creating volume 1dafb08a-daa6-444d-9535-dcd835adafec {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:29:33 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591b8bf8-367a-4e72-9134-32b3af1fcf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff95084-2e89-4356-9c6e-298e7ec992f4', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:34 devstack sudo[107948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec 1073741824
Sep 28 18:29:34 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a786a83-5f2e-4cc0-90db-b350238fb836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:34 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Volume volume-9ff95084-2e89-4356-9c6e-298e7ec992f4 (9ff95084-2e89-4356-9c6e-298e7ec992f4): created successfully
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a786a83-5f2e-4cc0-90db-b350238fb836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Flow 'volume_create_manager' (b6e80e16-72d8-45ef-a195-02c1276444bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:34 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-e27f327c-f6c2-4b75-95e9-27915fc43537 tempest-CreateVolumesFromImageTest-1599051730 None] Created volume successfully.
Sep 28 18:29:34 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD" returned: 1 in 0.396s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-969fb746-5fbe-4638-b59c-b3fecdbd4687 tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "cinder-9ff95084-2e89-4356-9c6e-298e7ec992f4-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-969fb746-5fbe-4638-b59c-b3fecdbd4687 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "cinder-9ff95084-2e89-4356-9c6e-298e7ec992f4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-969fb746-5fbe-4638-b59c-b3fecdbd4687 tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "cinder-quobyte-9ff95084-2e89-4356-9c6e-298e7ec992f4" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-969fb746-5fbe-4638-b59c-b3fecdbd4687 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "cinder-quobyte-9ff95084-2e89-4356-9c6e-298e7ec992f4" acquired by "delete_volume" :: waited 0.018s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5927de9-fea1-4ce1-ab47-14282f1c9670]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-969fb746-5fbe-4638-b59c-b3fecdbd4687 tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff95084-2e89-4356-9c6e-298e7ec992f4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:34 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec 1073741824" returned: 0 in 0.585s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:34 devstack sudo[107958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec
Sep 28 18:29:34 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:34 devstack sudo[107957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff95084-2e89-4356-9c6e-298e7ec992f4
Sep 28 18:29:34 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:34 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec" returned: 0 in 0.307s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-4eb1d971-ae01-4b05-b0c9-a9948a01d6b2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.961s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:34 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2ace75-1564-4c20-a9ea-27edd0a60c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dafb08a-daa6-444d-9535-dcd835adafec', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b41ef2f-2624-4cd9-a44d-c425f3532e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-4eb1d971-ae01-4b05-b0c9-a9948a01d6b2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Creating offline snapshot 092f3f6c-4721-45ed-9fba-0f5afe026b57 of volume 1b8e6e8a-2a7a-4259-9e2d-38a3605535d4 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-969fb746-5fbe-4638-b59c-b3fecdbd4687 tempest-CreateVolumesFromImageTest-1599051730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff95084-2e89-4356-9c6e-298e7ec992f4" returned: 0 in 0.437s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-969fb746-5fbe-4638-b59c-b3fecdbd4687 tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff95084-2e89-4356-9c6e-298e7ec992f4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:35 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Volume volume-1dafb08a-daa6-444d-9535-dcd835adafec (1dafb08a-daa6-444d-9535-dcd835adafec): created successfully
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b41ef2f-2624-4cd9-a44d-c425f3532e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Flow 'volume_create_manager' (9873bb1c-7736-4b3c-a453-61a286bf41a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86fecf5-c289-4002-b93a-0d27f960a9a7]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4eb1d971-ae01-4b05-b0c9-a9948a01d6b2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:35 devstack sudo[107999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff95084-2e89-4356-9c6e-298e7ec992f4
Sep 28 18:29:35 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:35 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-a9607793-f8d4-4332-b7ec-a9afc1b59dda tempest-CinderUnicodeTest-851630309 None] Created volume successfully.
Sep 28 18:29:35 devstack sudo[108001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4
Sep 28 18:29:35 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:35 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-969fb746-5fbe-4638-b59c-b3fecdbd4687 tempest-CreateVolumesFromImageTest-1599051730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9ff95084-2e89-4356-9c6e-298e7ec992f4" returned: 0 in 0.358s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-969fb746-5fbe-4638-b59c-b3fecdbd4687 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "cinder-quobyte-9ff95084-2e89-4356-9c6e-298e7ec992f4" released by "delete_volume" :: held 0.846s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-969fb746-5fbe-4638-b59c-b3fecdbd4687 tempest-CreateVolumesFromImageTest-1599051730 None] Created reservations ['0dbbb28a-ba6f-495e-924d-0bebe892cf28', '8f7ae83c-0fb0-4d62-9349-26a4fa45091c', '923ee528-e6f0-4fa5-9bf6-9acd4e96508e', '45b648ce-38c1-4e4f-bc62-26a1af2f6226'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:29:35 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4eb1d971-ae01-4b05-b0c9-a9948a01d6b2 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4" returned: 0 in 0.470s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4eb1d971-ae01-4b05-b0c9-a9948a01d6b2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.092f3f6c-4721-45ed-9fba-0f5afe026b57 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:35 devstack sudo[108009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.092f3f6c-4721-45ed-9fba-0f5afe026b57 1G
Sep 28 18:29:35 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-969fb746-5fbe-4638-b59c-b3fecdbd4687 tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-969fb746-5fbe-4638-b59c-b3fecdbd4687 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-969fb746-5fbe-4638-b59c-b3fecdbd4687 tempest-CreateVolumesFromImageTest-1599051730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-969fb746-5fbe-4638-b59c-b3fecdbd4687 tempest-CreateVolumesFromImageTest-1599051730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-969fb746-5fbe-4638-b59c-b3fecdbd4687 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-969fb746-5fbe-4638-b59c-b3fecdbd4687 tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:35 devstack sudo[108011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:29:35 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-09d19dd8-2b23-44ef-b865-a009ba7d36a0 tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "cinder-9f9fc3d3-55b0-4ec3-9573-f76a864ef045-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-09d19dd8-2b23-44ef-b865-a009ba7d36a0 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "cinder-9f9fc3d3-55b0-4ec3-9573-f76a864ef045-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-60ca883b-5aa7-40b7-9985-e1da3c616184 tempest-CinderUnicodeTest-851630309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-09d19dd8-2b23-44ef-b865-a009ba7d36a0 tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "cinder-quobyte-9f9fc3d3-55b0-4ec3-9573-f76a864ef045" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-09d19dd8-2b23-44ef-b865-a009ba7d36a0 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "cinder-quobyte-9f9fc3d3-55b0-4ec3-9573-f76a864ef045" acquired by "delete_volume" :: waited 0.023s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f843ac6-e01c-45be-ac23-e56e82b6e968]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-09d19dd8-2b23-44ef-b865-a009ba7d36a0 tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9f9fc3d3-55b0-4ec3-9573-f76a864ef045 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:35 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-969fb746-5fbe-4638-b59c-b3fecdbd4687 tempest-CreateVolumesFromImageTest-1599051730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.353s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-969fb746-5fbe-4638-b59c-b3fecdbd4687 tempest-CreateVolumesFromImageTest-1599051730 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:29:35 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-969fb746-5fbe-4638-b59c-b3fecdbd4687 tempest-CreateVolumesFromImageTest-1599051730 None] Deleted volume successfully.
Sep 28 18:29:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-969fb746-5fbe-4638-b59c-b3fecdbd4687 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "cinder-9ff95084-2e89-4356-9c6e-298e7ec992f4-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:35 devstack sudo[108013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9f9fc3d3-55b0-4ec3-9573-f76a864ef045
Sep 28 18:29:35 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:36 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4eb1d971-ae01-4b05-b0c9-a9948a01d6b2 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.092f3f6c-4721-45ed-9fba-0f5afe026b57 1G" returned: 0 in 0.648s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4eb1d971-ae01-4b05-b0c9-a9948a01d6b2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.092f3f6c-4721-45ed-9fba-0f5afe026b57 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:36 devstack sudo[108020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.092f3f6c-4721-45ed-9fba-0f5afe026b57
Sep 28 18:29:36 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:36 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-09d19dd8-2b23-44ef-b865-a009ba7d36a0 tempest-CreateVolumesFromImageTest-1599051730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9f9fc3d3-55b0-4ec3-9573-f76a864ef045" returned: 0 in 0.471s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-09d19dd8-2b23-44ef-b865-a009ba7d36a0 tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9f9fc3d3-55b0-4ec3-9573-f76a864ef045 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:36 devstack sudo[108025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9f9fc3d3-55b0-4ec3-9573-f76a864ef045
Sep 28 18:29:36 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:36 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4eb1d971-ae01-4b05-b0c9-a9948a01d6b2 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.092f3f6c-4721-45ed-9fba-0f5afe026b57" returned: 0 in 0.315s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:36 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-4eb1d971-ae01-4b05-b0c9-a9948a01d6b2 tempest-CreateVolumesFromSnapshotTest-859314465 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.092f3f6c-4721-45ed-9fba-0f5afe026b57 is being set with open permissions: ugo+rw
Sep 28 18:29:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4eb1d971-ae01-4b05-b0c9-a9948a01d6b2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.092f3f6c-4721-45ed-9fba-0f5afe026b57 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:36 devstack sudo[108030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.092f3f6c-4721-45ed-9fba-0f5afe026b57
Sep 28 18:29:36 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:36 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-09d19dd8-2b23-44ef-b865-a009ba7d36a0 tempest-CreateVolumesFromImageTest-1599051730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-9f9fc3d3-55b0-4ec3-9573-f76a864ef045" returned: 0 in 0.294s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-09d19dd8-2b23-44ef-b865-a009ba7d36a0 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "cinder-quobyte-9f9fc3d3-55b0-4ec3-9573-f76a864ef045" released by "delete_volume" :: held 0.833s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:36 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-09d19dd8-2b23-44ef-b865-a009ba7d36a0 tempest-CreateVolumesFromImageTest-1599051730 None] Created reservations ['58c527e0-6118-4378-9286-c20a9557fe8d', '1887add9-f746-44da-9757-a17551dc9e4d', '80bc35da-ad9b-4bb0-98ab-ce235589902e', '79b8a5af-4f95-4770-87a2-92aa969a1bd2'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:29:36 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4eb1d971-ae01-4b05-b0c9-a9948a01d6b2 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.092f3f6c-4721-45ed-9fba-0f5afe026b57" returned: 0 in 0.285s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-09d19dd8-2b23-44ef-b865-a009ba7d36a0 tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-09d19dd8-2b23-44ef-b865-a009ba7d36a0 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-09d19dd8-2b23-44ef-b865-a009ba7d36a0 tempest-CreateVolumesFromImageTest-1599051730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-09d19dd8-2b23-44ef-b865-a009ba7d36a0 tempest-CreateVolumesFromImageTest-1599051730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-09d19dd8-2b23-44ef-b865-a009ba7d36a0 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-09d19dd8-2b23-44ef-b865-a009ba7d36a0 tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:36 devstack sudo[108034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:29:36 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4eb1d971-ae01-4b05-b0c9-a9948a01d6b2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:36 devstack sudo[108036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.info
Sep 28 18:29:36 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-acd0b5b9-c6af-4b30-9d3f-07ba1ff755cf tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "cinder-3324328b-435d-4fd5-82fa-d9ad15471939-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-acd0b5b9-c6af-4b30-9d3f-07ba1ff755cf tempest-CreateVolumesFromImageTest-1599051730 None] Lock "cinder-3324328b-435d-4fd5-82fa-d9ad15471939-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-acd0b5b9-c6af-4b30-9d3f-07ba1ff755cf tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "cinder-quobyte-3324328b-435d-4fd5-82fa-d9ad15471939" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-acd0b5b9-c6af-4b30-9d3f-07ba1ff755cf tempest-CreateVolumesFromImageTest-1599051730 None] Lock "cinder-quobyte-3324328b-435d-4fd5-82fa-d9ad15471939" acquired by "delete_volume" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cab5475-740d-4b23-b95b-235017827b7d]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-acd0b5b9-c6af-4b30-9d3f-07ba1ff755cf tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3324328b-435d-4fd5-82fa-d9ad15471939 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:37 devstack sudo[108038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3324328b-435d-4fd5-82fa-d9ad15471939
Sep 28 18:29:37 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:37 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:37 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-09d19dd8-2b23-44ef-b865-a009ba7d36a0 tempest-CreateVolumesFromImageTest-1599051730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.374s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4eb1d971-ae01-4b05-b0c9-a9948a01d6b2 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.info" returned: 0 in 0.339s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-09d19dd8-2b23-44ef-b865-a009ba7d36a0 tempest-CreateVolumesFromImageTest-1599051730 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:29:37 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-4eb1d971-ae01-4b05-b0c9-a9948a01d6b2 tempest-CreateVolumesFromSnapshotTest-859314465 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.info is being set with open permissions: ugo+rw
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4eb1d971-ae01-4b05-b0c9-a9948a01d6b2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:37 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-09d19dd8-2b23-44ef-b865-a009ba7d36a0 tempest-CreateVolumesFromImageTest-1599051730 None] Deleted volume successfully.
Sep 28 18:29:37 devstack sudo[108042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.info
Sep 28 18:29:37 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-09d19dd8-2b23-44ef-b865-a009ba7d36a0 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "cinder-9f9fc3d3-55b0-4ec3-9573-f76a864ef045-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:37 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-acd0b5b9-c6af-4b30-9d3f-07ba1ff755cf tempest-CreateVolumesFromImageTest-1599051730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3324328b-435d-4fd5-82fa-d9ad15471939" returned: 0 in 0.428s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-acd0b5b9-c6af-4b30-9d3f-07ba1ff755cf tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3324328b-435d-4fd5-82fa-d9ad15471939 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:37 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4eb1d971-ae01-4b05-b0c9-a9948a01d6b2 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.info" returned: 0 in 0.303s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:37 devstack sudo[108048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3324328b-435d-4fd5-82fa-d9ad15471939
Sep 28 18:29:37 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-4eb1d971-ae01-4b05-b0c9-a9948a01d6b2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.573s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.339s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98223190-7b9e-42d8-bf0d-74c5fd45089d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8ff197da8c54e519e5c9125b4624277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:32Z,use_quota=True,user_id='16ad8e4e27e242bf8d87cc61919f4830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33687111-8171-4f95-a9e0-f8b518ba04b3),volume_type_id=33687111-8171-4f95-a9e0-f8b518ba04b3)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Creating volume 98223190-7b9e-42d8-bf0d-74c5fd45089d {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:29:37 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-98223190-7b9e-42d8-bf0d-74c5fd45089d 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:37 devstack sudo[108050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-98223190-7b9e-42d8-bf0d-74c5fd45089d 1073741824
Sep 28 18:29:37 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:37 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-4eb1d971-ae01-4b05-b0c9-a9948a01d6b2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Create snapshot completed successfully
Sep 28 18:29:37 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-acd0b5b9-c6af-4b30-9d3f-07ba1ff755cf tempest-CreateVolumesFromImageTest-1599051730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-3324328b-435d-4fd5-82fa-d9ad15471939" returned: 0 in 0.321s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-acd0b5b9-c6af-4b30-9d3f-07ba1ff755cf tempest-CreateVolumesFromImageTest-1599051730 None] Lock "cinder-quobyte-3324328b-435d-4fd5-82fa-d9ad15471939" released by "delete_volume" :: held 0.823s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-acd0b5b9-c6af-4b30-9d3f-07ba1ff755cf tempest-CreateVolumesFromImageTest-1599051730 None] Created reservations ['aae0e621-7e4d-44fd-bde1-85695fbcd836', '5f17debf-ae0c-4b8d-bf42-47bc4c2b1a84', '62af685b-a3b6-42bc-aa01-61d86c32bbe1', '507e3605-0125-4cc6-8c2d-666ac545421d'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-acd0b5b9-c6af-4b30-9d3f-07ba1ff755cf tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-acd0b5b9-c6af-4b30-9d3f-07ba1ff755cf tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-acd0b5b9-c6af-4b30-9d3f-07ba1ff755cf tempest-CreateVolumesFromImageTest-1599051730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-acd0b5b9-c6af-4b30-9d3f-07ba1ff755cf tempest-CreateVolumesFromImageTest-1599051730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-acd0b5b9-c6af-4b30-9d3f-07ba1ff755cf tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-acd0b5b9-c6af-4b30-9d3f-07ba1ff755cf tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:37 devstack sudo[108056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:29:37 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e712fe27-5894-43ab-ab8b-efdcc5eefa79 tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "cinder-a9d94c11-050b-4907-8701-e983013c93a8-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:38 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-98223190-7b9e-42d8-bf0d-74c5fd45089d 1073741824" returned: 0 in 0.600s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e712fe27-5894-43ab-ab8b-efdcc5eefa79 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "cinder-a9d94c11-050b-4907-8701-e983013c93a8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e712fe27-5894-43ab-ab8b-efdcc5eefa79 tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "cinder-quobyte-a9d94c11-050b-4907-8701-e983013c93a8" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-98223190-7b9e-42d8-bf0d-74c5fd45089d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e712fe27-5894-43ab-ab8b-efdcc5eefa79 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "cinder-quobyte-a9d94c11-050b-4907-8701-e983013c93a8" acquired by "delete_volume" :: waited 0.034s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:38 devstack sudo[108059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-98223190-7b9e-42d8-bf0d-74c5fd45089d
Sep 28 18:29:38 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[770773a4-de6b-4e23-9aa2-814c2d60404d]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e712fe27-5894-43ab-ab8b-efdcc5eefa79 tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a9d94c11-050b-4907-8701-e983013c93a8 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:38 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-acd0b5b9-c6af-4b30-9d3f-07ba1ff755cf tempest-CreateVolumesFromImageTest-1599051730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.346s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-acd0b5b9-c6af-4b30-9d3f-07ba1ff755cf tempest-CreateVolumesFromImageTest-1599051730 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:29:38 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-acd0b5b9-c6af-4b30-9d3f-07ba1ff755cf tempest-CreateVolumesFromImageTest-1599051730 None] Deleted volume successfully.
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-acd0b5b9-c6af-4b30-9d3f-07ba1ff755cf tempest-CreateVolumesFromImageTest-1599051730 None] Lock "cinder-3324328b-435d-4fd5-82fa-d9ad15471939-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:38 devstack sudo[108062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a9d94c11-050b-4907-8701-e983013c93a8
Sep 28 18:29:38 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:38 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-98223190-7b9e-42d8-bf0d-74c5fd45089d" returned: 0 in 0.339s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-60ca883b-5aa7-40b7-9985-e1da3c616184 tempest-CinderUnicodeTest-851630309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.838s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-60ca883b-5aa7-40b7-9985-e1da3c616184 tempest-CinderUnicodeTest-851630309 None] Creating offline snapshot fece1b64-c4a5-4d56-8a17-dba8b19dc3dd of volume 1dafb08a-daa6-444d-9535-dcd835adafec {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Attempting download of d644095a-57ba-4142-8962-a8804fc8ee08 ((None, [{'url': 'file:///opt/stack/data/glance/images/d644095a-57ba-4142-8962-a8804fc8ee08', 'metadata': {}}])) to volume 98223190-7b9e-42d8-bf0d-74c5fd45089d. {{(pid=87046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f664ae1e-bbd5-4aa7-9e07-b2b75e0022c2]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-60ca883b-5aa7-40b7-9985-e1da3c616184 tempest-CinderUnicodeTest-851630309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a85187-0178-4d0a-8a64-bd84376f64f5]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d644095a-57ba-4142-8962-a8804fc8ee08_p1hd_rtq {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:38 devstack sudo[108068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d644095a-57ba-4142-8962-a8804fc8ee08_p1hd_rtq
Sep 28 18:29:38 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:38 devstack sudo[108065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec
Sep 28 18:29:38 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:38 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e712fe27-5894-43ab-ab8b-efdcc5eefa79 tempest-CreateVolumesFromImageTest-1599051730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a9d94c11-050b-4907-8701-e983013c93a8" returned: 0 in 0.564s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e712fe27-5894-43ab-ab8b-efdcc5eefa79 tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a9d94c11-050b-4907-8701-e983013c93a8 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:38 devstack sudo[108072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a9d94c11-050b-4907-8701-e983013c93a8
Sep 28 18:29:38 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:38 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Flow 'volume_create_manager' (147caa0f-8b76-47c7-a750-4a635d1b6fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725ca03f-f7cd-4954-b80a-a362e5e7e6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725ca03f-f7cd-4954-b80a-a362e5e7e6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-600813110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5648998b-0366-46ff-8ddb-d3ca08a682b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeb3f91dba041cf90cb0a77d65f7462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:39Z,use_quota=True,user_id='8b662392cce94af1afbb63c334c54a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6100bda7-c7f7-473f-a105-e1719396d227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6100bda7-c7f7-473f-a105-e1719396d227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6ffa26-3a50-465b-a2c1-16779e4477cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6ffa26-3a50-465b-a2c1-16779e4477cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5648998b-0366-46ff-8ddb-d3ca08a682b2', 'volume_name': 'volume-5648998b-0366-46ff-8ddb-d3ca08a682b2', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca0163ad-f6de-4a4d-8458-bf8114bc09a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca0163ad-f6de-4a4d-8458-bf8114bc09a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a31f41-2ccf-4b41-85a9-5d5869d01990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:39 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Volume 5648998b-0366-46ff-8ddb-d3ca08a682b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5648998b-0366-46ff-8ddb-d3ca08a682b2', 'volume_size': 1}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:39 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e712fe27-5894-43ab-ab8b-efdcc5eefa79 tempest-CreateVolumesFromImageTest-1599051730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a9d94c11-050b-4907-8701-e983013c93a8" returned: 0 in 0.344s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:39 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d644095a-57ba-4142-8962-a8804fc8ee08_p1hd_rtq" returned: 0 in 0.516s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d644095a-57ba-4142-8962-a8804fc8ee08_p1hd_rtq {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e712fe27-5894-43ab-ab8b-efdcc5eefa79 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "cinder-quobyte-a9d94c11-050b-4907-8701-e983013c93a8" released by "delete_volume" :: held 1.013s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:39 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-60ca883b-5aa7-40b7-9985-e1da3c616184 tempest-CinderUnicodeTest-851630309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec" returned: 0 in 0.663s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-60ca883b-5aa7-40b7-9985-e1da3c616184 tempest-CinderUnicodeTest-851630309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.fece1b64-c4a5-4d56-8a17-dba8b19dc3dd 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:39 devstack sudo[108081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.fece1b64-c4a5-4d56-8a17-dba8b19dc3dd 1G
Sep 28 18:29:39 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-e712fe27-5894-43ab-ab8b-efdcc5eefa79 tempest-CreateVolumesFromImageTest-1599051730 None] Created reservations ['e8202dde-bb39-4447-b1d3-5ca004d0bb72', '568018bf-e692-4116-8e5f-6e287409d677', '6b811be0-355d-4dc4-a5c2-b08ed4457318', '6f6df7af-396c-4bce-bfbd-69c51bf05b11'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:39 devstack sudo[108080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d644095a-57ba-4142-8962-a8804fc8ee08_p1hd_rtq
Sep 28 18:29:39 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:39 devstack sudo[108083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:29:39 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Flow 'volume_create_manager' (448f5e11-9b92-4235-a464-dc13fd944385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7295b8-8b29-44d8-a3b1-52812e2d597d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7295b8-8b29-44d8-a3b1-52812e2d597d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1139142232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a114118-30e6-4bb2-be98-9a2d66179482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeb3f91dba041cf90cb0a77d65f7462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:39Z,use_quota=True,user_id='8b662392cce94af1afbb63c334c54a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb6f3db-811a-4077-9dda-e4c328f3b3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb6f3db-811a-4077-9dda-e4c328f3b3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed28cd9-a011-4043-8ea8-6b7d9f5fbcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed28cd9-a011-4043-8ea8-6b7d9f5fbcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a114118-30e6-4bb2-be98-9a2d66179482', 'volume_name': 'volume-2a114118-30e6-4bb2-be98-9a2d66179482', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eecc165-7076-44f3-9086-37359e882129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eecc165-7076-44f3-9086-37359e882129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f6f1fd0-65f2-480a-9bb8-f60fe0df1d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:39 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Volume 2a114118-30e6-4bb2-be98-9a2d66179482: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a114118-30e6-4bb2-be98-9a2d66179482', 'volume_size': 1}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e712fe27-5894-43ab-ab8b-efdcc5eefa79 tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e712fe27-5894-43ab-ab8b-efdcc5eefa79 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e712fe27-5894-43ab-ab8b-efdcc5eefa79 tempest-CreateVolumesFromImageTest-1599051730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e712fe27-5894-43ab-ab8b-efdcc5eefa79 tempest-CreateVolumesFromImageTest-1599051730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e712fe27-5894-43ab-ab8b-efdcc5eefa79 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e712fe27-5894-43ab-ab8b-efdcc5eefa79 tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:39 devstack sudo[108088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:29:39 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:39 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d644095a-57ba-4142-8962-a8804fc8ee08_p1hd_rtq" returned: 1 in 0.644s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d644095a-57ba-4142-8962-a8804fc8ee08_p1hd_rtq' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31dad1d-4c92-400d-9526-032b482f5d29]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:39 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.504s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:29:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:29:40 devstack sudo[108094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD
Sep 28 18:29:40 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:40 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-60ca883b-5aa7-40b7-9985-e1da3c616184 tempest-CinderUnicodeTest-851630309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.fece1b64-c4a5-4d56-8a17-dba8b19dc3dd 1G" returned: 0 in 0.766s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-60ca883b-5aa7-40b7-9985-e1da3c616184 tempest-CinderUnicodeTest-851630309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dafb08a-daa6-444d-9535-dcd835adafec -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.fece1b64-c4a5-4d56-8a17-dba8b19dc3dd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:40 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:40 devstack sudo[108099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dafb08a-daa6-444d-9535-dcd835adafec -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.fece1b64-c4a5-4d56-8a17-dba8b19dc3dd
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e712fe27-5894-43ab-ab8b-efdcc5eefa79 tempest-CreateVolumesFromImageTest-1599051730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.431s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-e712fe27-5894-43ab-ab8b-efdcc5eefa79 tempest-CreateVolumesFromImageTest-1599051730 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:29:40 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:40 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-e712fe27-5894-43ab-ab8b-efdcc5eefa79 tempest-CreateVolumesFromImageTest-1599051730 None] Deleted volume successfully.
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e712fe27-5894-43ab-ab8b-efdcc5eefa79 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "cinder-a9d94c11-050b-4907-8701-e983013c93a8-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Flow 'volume_create_manager' (2e2e4441-346e-40e9-82fd-f5829cdad6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d55713-a216-444a-a334-30aa737da576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d55713-a216-444a-a334-30aa737da576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-979277397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c781470-f62d-46c1-a821-92307709c585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeb3f91dba041cf90cb0a77d65f7462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:40Z,use_quota=True,user_id='8b662392cce94af1afbb63c334c54a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ba400f-d1fa-443d-b869-af32b5f16216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ba400f-d1fa-443d-b869-af32b5f16216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab5eb77-4427-46f4-a5d1-2f58e8d0d0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab5eb77-4427-46f4-a5d1-2f58e8d0d0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c781470-f62d-46c1-a821-92307709c585', 'volume_name': 'volume-1c781470-f62d-46c1-a821-92307709c585', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a52e182-4ad9-4772-af2a-f454672e608b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a52e182-4ad9-4772-af2a-f454672e608b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74baecdf-0bbe-4835-b7d2-2b34beda77e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:40 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Volume 1c781470-f62d-46c1-a821-92307709c585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c781470-f62d-46c1-a821-92307709c585', 'volume_size': 1}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:40 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD" returned: 0 in 0.528s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d20f9525-0c1e-4c54-8fcc-63cfb0447035 tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "cinder-92cb2313-8118-4a01-b584-2a98f3ba8beb-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d20f9525-0c1e-4c54-8fcc-63cfb0447035 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "cinder-92cb2313-8118-4a01-b584-2a98f3ba8beb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:40 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-60ca883b-5aa7-40b7-9985-e1da3c616184 tempest-CinderUnicodeTest-851630309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dafb08a-daa6-444d-9535-dcd835adafec -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.fece1b64-c4a5-4d56-8a17-dba8b19dc3dd" returned: 0 in 0.493s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:40 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-60ca883b-5aa7-40b7-9985-e1da3c616184 tempest-CinderUnicodeTest-851630309 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.fece1b64-c4a5-4d56-8a17-dba8b19dc3dd is being set with open permissions: ugo+rw
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-60ca883b-5aa7-40b7-9985-e1da3c616184 tempest-CinderUnicodeTest-851630309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.fece1b64-c4a5-4d56-8a17-dba8b19dc3dd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:40 devstack sudo[108103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD
Sep 28 18:29:40 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d20f9525-0c1e-4c54-8fcc-63cfb0447035 tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "cinder-quobyte-92cb2313-8118-4a01-b584-2a98f3ba8beb" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:40 devstack sudo[108108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.fece1b64-c4a5-4d56-8a17-dba8b19dc3dd
Sep 28 18:29:40 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d20f9525-0c1e-4c54-8fcc-63cfb0447035 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "cinder-quobyte-92cb2313-8118-4a01-b584-2a98f3ba8beb" acquired by "delete_volume" :: waited 0.027s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e32aa5-1053-4ff9-a25a-e282340f0bc1]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d20f9525-0c1e-4c54-8fcc-63cfb0447035 tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-92cb2313-8118-4a01-b584-2a98f3ba8beb {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:40 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:40 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-60ca883b-5aa7-40b7-9985-e1da3c616184 tempest-CinderUnicodeTest-851630309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.fece1b64-c4a5-4d56-8a17-dba8b19dc3dd" returned: 0 in 0.327s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD" returned: 1 in 0.502s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] d644095a-57ba-4142-8962-a8804fc8ee08 was raw, converting to qcow2 {{(pid=87046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 28 18:29:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-98223190-7b9e-42d8-bf0d-74c5fd45089d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:40 devstack sudo[108110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-92cb2313-8118-4a01-b584-2a98f3ba8beb
Sep 28 18:29:40 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:40 devstack sudo[108115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-98223190-7b9e-42d8-bf0d-74c5fd45089d
Sep 28 18:29:40 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-60ca883b-5aa7-40b7-9985-e1da3c616184 tempest-CinderUnicodeTest-851630309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:29:41 devstack sudo[108118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.info
Sep 28 18:29:41 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Flow 'volume_create_manager' (ab467cb4-cba8-428c-99ce-34a55b326771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2178d4b-a778-438f-b1b0-3ca5471642d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2178d4b-a778-438f-b1b0-3ca5471642d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1825365103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1096c7-0404-4b41-8e77-513178f5dec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeb3f91dba041cf90cb0a77d65f7462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:41Z,use_quota=True,user_id='8b662392cce94af1afbb63c334c54a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c63007-b5c1-4c82-a0d5-66e0a72c830e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c63007-b5c1-4c82-a0d5-66e0a72c830e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (610c9574-fd2d-459c-80d0-9a203ded7144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (610c9574-fd2d-459c-80d0-9a203ded7144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd1096c7-0404-4b41-8e77-513178f5dec4', 'volume_name': 'volume-cd1096c7-0404-4b41-8e77-513178f5dec4', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2677f8d5-c10f-49fb-9e6f-50ac6b484db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2677f8d5-c10f-49fb-9e6f-50ac6b484db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf02b331-0adf-4ad5-b7c6-32ed91819cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:41 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Volume cd1096c7-0404-4b41-8e77-513178f5dec4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd1096c7-0404-4b41-8e77-513178f5dec4', 'volume_size': 1}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:41 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d20f9525-0c1e-4c54-8fcc-63cfb0447035 tempest-CreateVolumesFromImageTest-1599051730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-92cb2313-8118-4a01-b584-2a98f3ba8beb" returned: 0 in 0.671s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d20f9525-0c1e-4c54-8fcc-63cfb0447035 tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-92cb2313-8118-4a01-b584-2a98f3ba8beb {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:29:41 devstack sudo[108127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-92cb2313-8118-4a01-b584-2a98f3ba8beb
Sep 28 18:29:41 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Flow 'volume_create_manager' (6c21c782-544c-493e-a8b7-ecd7cbea87c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d76ef224-92a5-400e-9dc0-e3edb33175fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:41 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-60ca883b-5aa7-40b7-9985-e1da3c616184 tempest-CinderUnicodeTest-851630309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.info" returned: 0 in 0.459s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:41 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-60ca883b-5aa7-40b7-9985-e1da3c616184 tempest-CinderUnicodeTest-851630309 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.info is being set with open permissions: ugo+rw
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-60ca883b-5aa7-40b7-9985-e1da3c616184 tempest-CinderUnicodeTest-851630309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d76ef224-92a5-400e-9dc0-e3edb33175fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-951810560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a829a5f-9678-46c5-a619-b0a83b36ba28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeb3f91dba041cf90cb0a77d65f7462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:41Z,use_quota=True,user_id='8b662392cce94af1afbb63c334c54a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2879a3cb-ad84-4e4a-a75d-f61a8c53efa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2879a3cb-ad84-4e4a-a75d-f61a8c53efa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3daefe-9410-401c-b71d-4723b4983de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:41 devstack sudo[108129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.info
Sep 28 18:29:41 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3daefe-9410-401c-b71d-4723b4983de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a829a5f-9678-46c5-a619-b0a83b36ba28', 'volume_name': 'volume-2a829a5f-9678-46c5-a619-b0a83b36ba28', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c610e74-e4f2-4bf0-8ed8-d4b297fec8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c610e74-e4f2-4bf0-8ed8-d4b297fec8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3a3a9a-d7f2-4660-acdf-0447d4bfb3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:41 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Volume 2a829a5f-9678-46c5-a619-b0a83b36ba28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a829a5f-9678-46c5-a619-b0a83b36ba28', 'volume_size': 1}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:41 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-98223190-7b9e-42d8-bf0d-74c5fd45089d" returned: 0 in 0.755s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d644095a-57ba-4142-8962-a8804fc8ee08_dbs5cz61devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-98223190-7b9e-42d8-bf0d-74c5fd45089d {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:29:41 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Converted 0.00 MB image at 0.00 MB/s
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-98223190-7b9e-42d8-bf0d-74c5fd45089d 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:41 devstack sudo[108133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-98223190-7b9e-42d8-bf0d-74c5fd45089d 1G
Sep 28 18:29:41 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:41 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d20f9525-0c1e-4c54-8fcc-63cfb0447035 tempest-CreateVolumesFromImageTest-1599051730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-92cb2313-8118-4a01-b584-2a98f3ba8beb" returned: 0 in 0.331s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d20f9525-0c1e-4c54-8fcc-63cfb0447035 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "cinder-quobyte-92cb2313-8118-4a01-b584-2a98f3ba8beb" released by "delete_volume" :: held 1.110s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:41 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-60ca883b-5aa7-40b7-9985-e1da3c616184 tempest-CinderUnicodeTest-851630309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.info" returned: 0 in 0.326s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-60ca883b-5aa7-40b7-9985-e1da3c616184 tempest-CinderUnicodeTest-851630309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.269s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.738s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-600813110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5648998b-0366-46ff-8ddb-d3ca08a682b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeb3f91dba041cf90cb0a77d65f7462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:39Z,use_quota=True,user_id='8b662392cce94af1afbb63c334c54a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Creating volume 5648998b-0366-46ff-8ddb-d3ca08a682b2 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:29:41 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5648998b-0366-46ff-8ddb-d3ca08a682b2 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:41 devstack sudo[108136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5648998b-0366-46ff-8ddb-d3ca08a682b2 1073741824
Sep 28 18:29:41 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-d20f9525-0c1e-4c54-8fcc-63cfb0447035 tempest-CreateVolumesFromImageTest-1599051730 None] Created reservations ['cafbafef-c636-4a0c-90cb-2b50740e201b', 'ec69d2d3-6da0-45ea-a535-7cdeec6293ba', 'c1e338cc-20f2-4d2b-8fd8-de4f915615db', 'c1844d0a-1a78-4480-b067-98d67fc5d4ab'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:29:41 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-60ca883b-5aa7-40b7-9985-e1da3c616184 tempest-CinderUnicodeTest-851630309 None] Create snapshot completed successfully
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d20f9525-0c1e-4c54-8fcc-63cfb0447035 tempest-CreateVolumesFromImageTest-1599051730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d20f9525-0c1e-4c54-8fcc-63cfb0447035 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d20f9525-0c1e-4c54-8fcc-63cfb0447035 tempest-CreateVolumesFromImageTest-1599051730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d20f9525-0c1e-4c54-8fcc-63cfb0447035 tempest-CreateVolumesFromImageTest-1599051730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d20f9525-0c1e-4c54-8fcc-63cfb0447035 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d20f9525-0c1e-4c54-8fcc-63cfb0447035 tempest-CreateVolumesFromImageTest-1599051730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:42 devstack sudo[108141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:29:42 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:42 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-98223190-7b9e-42d8-bf0d-74c5fd45089d 1G" returned: 0 in 0.482s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Downloaded image d644095a-57ba-4142-8962-a8804fc8ee08 ((None, [{'url': 'file:///opt/stack/data/glance/images/d644095a-57ba-4142-8962-a8804fc8ee08', 'metadata': {}}])) to volume 98223190-7b9e-42d8-bf0d-74c5fd45089d successfully. {{(pid=87046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Temporary image d644095a-57ba-4142-8962-a8804fc8ee08 for user 16ad8e4e27e242bf8d87cc61919f4830 is deleted. {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Marking volume 98223190-7b9e-42d8-bf0d-74c5fd45089d as bootable. {{(pid=87046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3e92da2d-09dc-407e-b319-7cc0d491ed46 tempest-CinderUnicodeTest-851630309 None] Acquiring lock "cinder-fece1b64-c4a5-4d56-8a17-dba8b19dc3dd-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Copying metadata from image d644095a-57ba-4142-8962-a8804fc8ee08 to 98223190-7b9e-42d8-bf0d-74c5fd45089d. {{(pid=87046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Creating volume glance metadata for volume 98223190-7b9e-42d8-bf0d-74c5fd45089d backed by image d644095a-57ba-4142-8962-a8804fc8ee08 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd644095a-57ba-4142-8962-a8804fc8ee08', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6c1000349b5da314d2707551b3303497', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3e92da2d-09dc-407e-b319-7cc0d491ed46 tempest-CinderUnicodeTest-851630309 None] Lock "cinder-fece1b64-c4a5-4d56-8a17-dba8b19dc3dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3e92da2d-09dc-407e-b319-7cc0d491ed46 tempest-CinderUnicodeTest-851630309 None] Acquiring lock "cinder-quobyte-1dafb08a-daa6-444d-9535-dcd835adafec" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3e92da2d-09dc-407e-b319-7cc0d491ed46 tempest-CinderUnicodeTest-851630309 None] Lock "cinder-quobyte-1dafb08a-daa6-444d-9535-dcd835adafec" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3e92da2d-09dc-407e-b319-7cc0d491ed46 tempest-CinderUnicodeTest-851630309 None] Acquiring lock "cinder-quobyte-fece1b64-c4a5-4d56-8a17-dba8b19dc3dd" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3e92da2d-09dc-407e-b319-7cc0d491ed46 tempest-CinderUnicodeTest-851630309 None] Lock "cinder-quobyte-fece1b64-c4a5-4d56-8a17-dba8b19dc3dd" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-3e92da2d-09dc-407e-b319-7cc0d491ed46 tempest-CinderUnicodeTest-851630309 None] Deleting offline snapshot fece1b64-c4a5-4d56-8a17-dba8b19dc3dd of volume 1dafb08a-daa6-444d-9535-dcd835adafec {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:29:42 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-3e92da2d-09dc-407e-b319-7cc0d491ed46 tempest-CinderUnicodeTest-851630309 None] snapshot_file for this snap is: volume-1dafb08a-daa6-444d-9535-dcd835adafec.fece1b64-c4a5-4d56-8a17-dba8b19dc3dd {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d20f9525-0c1e-4c54-8fcc-63cfb0447035 tempest-CreateVolumesFromImageTest-1599051730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.352s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d20f9525-0c1e-4c54-8fcc-63cfb0447035 tempest-CreateVolumesFromImageTest-1599051730 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d151d9ae-364c-410d-8eaa-0246fdb6bb0d]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:42 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d20f9525-0c1e-4c54-8fcc-63cfb0447035 tempest-CreateVolumesFromImageTest-1599051730 None] Deleted volume successfully.
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3e92da2d-09dc-407e-b319-7cc0d491ed46 tempest-CinderUnicodeTest-851630309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.fece1b64-c4a5-4d56-8a17-dba8b19dc3dd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d20f9525-0c1e-4c54-8fcc-63cfb0447035 tempest-CreateVolumesFromImageTest-1599051730 None] Lock "cinder-92cb2313-8118-4a01-b584-2a98f3ba8beb-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69712b97-3708-4b8b-9fd9-e3b03db6c8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98223190-7b9e-42d8-bf0d-74c5fd45089d', 'volume_size': 1, 'image_id': 'd644095a-57ba-4142-8962-a8804fc8ee08', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d644095a-57ba-4142-8962-a8804fc8ee08', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6c1000349b5da314d2707551b3303497', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b8ff197da8c54e519e5c9125b4624277', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9f2c9ebdcc0a47b7e3802019fcd5c198067c64509b332c286edd027647c774a2f2786ba084ec15bbcfa81f78b72063d767baf3015960ebccd1547304eb217976', 'id': 'd644095a-57ba-4142-8962-a8804fc8ee08', 'created_at': datetime.datetime(2026, 9, 28, 16, 29, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 29, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d644095a-57ba-4142-8962-a8804fc8ee08/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aaee8af90>}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:42 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95972f4c-b9e8-47cb-b172-954ebf2f9457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5648998b-0366-46ff-8ddb-d3ca08a682b2 1073741824" returned: 0 in 0.622s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:42 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Volume volume-98223190-7b9e-42d8-bf0d-74c5fd45089d (98223190-7b9e-42d8-bf0d-74c5fd45089d): created successfully
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95972f4c-b9e8-47cb-b172-954ebf2f9457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:42 devstack sudo[108148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.fece1b64-c4a5-4d56-8a17-dba8b19dc3dd
Sep 28 18:29:42 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Flow 'volume_create_manager' (a47b002f-ca8a-4124-9658-328d4a57bac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:42 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-88ac4708-7af0-4320-ae4e-fa2dba36738d tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Created volume successfully.
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5648998b-0366-46ff-8ddb-d3ca08a682b2 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:42 devstack sudo[108150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5648998b-0366-46ff-8ddb-d3ca08a682b2
Sep 28 18:29:42 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e907f7b0-703e-4c9a-9424-62bd67a401b0 tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Acquiring lock "cinder-98223190-7b9e-42d8-bf0d-74c5fd45089d-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e907f7b0-703e-4c9a-9424-62bd67a401b0 tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Lock "cinder-98223190-7b9e-42d8-bf0d-74c5fd45089d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e907f7b0-703e-4c9a-9424-62bd67a401b0 tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Acquiring lock "cinder-quobyte-98223190-7b9e-42d8-bf0d-74c5fd45089d" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e907f7b0-703e-4c9a-9424-62bd67a401b0 tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Lock "cinder-quobyte-98223190-7b9e-42d8-bf0d-74c5fd45089d" acquired by "delete_volume" :: waited 0.019s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0211b4a-fc20-4037-855f-7994d840cc91]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e907f7b0-703e-4c9a-9424-62bd67a401b0 tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-98223190-7b9e-42d8-bf0d-74c5fd45089d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:42 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3e92da2d-09dc-407e-b319-7cc0d491ed46 tempest-CinderUnicodeTest-851630309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.fece1b64-c4a5-4d56-8a17-dba8b19dc3dd" returned: 0 in 0.515s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-3e92da2d-09dc-407e-b319-7cc0d491ed46 tempest-CinderUnicodeTest-851630309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dafb08a-daa6-444d-9535-dcd835adafec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[af22fc91-1686-4843-a883-ee2f5abe816c]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3e92da2d-09dc-407e-b319-7cc0d491ed46 tempest-CinderUnicodeTest-851630309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:42 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5648998b-0366-46ff-8ddb-d3ca08a682b2" returned: 0 in 0.397s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.293s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1139142232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a114118-30e6-4bb2-be98-9a2d66179482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeb3f91dba041cf90cb0a77d65f7462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:39Z,use_quota=True,user_id='8b662392cce94af1afbb63c334c54a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Creating volume 2a114118-30e6-4bb2-be98-9a2d66179482 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:29:42 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:29:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a114118-30e6-4bb2-be98-9a2d66179482 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:42 devstack sudo[108160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-98223190-7b9e-42d8-bf0d-74c5fd45089d
Sep 28 18:29:42 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a31f41-2ccf-4b41-85a9-5d5869d01990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5648998b-0366-46ff-8ddb-d3ca08a682b2', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e9c35f-39e9-42ca-91b1-69d37be5e095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:43 devstack sudo[108164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a114118-30e6-4bb2-be98-9a2d66179482 1073741824
Sep 28 18:29:43 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:43 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Volume volume-5648998b-0366-46ff-8ddb-d3ca08a682b2 (5648998b-0366-46ff-8ddb-d3ca08a682b2): created successfully
Sep 28 18:29:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e9c35f-39e9-42ca-91b1-69d37be5e095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Flow 'volume_create_manager' (147caa0f-8b76-47c7-a750-4a635d1b6fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:43 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-f030b2be-ff60-4c4f-9f84-e65193b00f80 tempest-CreateVolumesFromSnapshotTest-859314465 None] Created volume successfully.
Sep 28 18:29:43 devstack sudo[108162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec
Sep 28 18:29:43 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:43 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e907f7b0-703e-4c9a-9424-62bd67a401b0 tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-98223190-7b9e-42d8-bf0d-74c5fd45089d" returned: 0 in 0.531s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e907f7b0-703e-4c9a-9424-62bd67a401b0 tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-98223190-7b9e-42d8-bf0d-74c5fd45089d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:43 devstack sudo[108177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-98223190-7b9e-42d8-bf0d-74c5fd45089d
Sep 28 18:29:43 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:43 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3e92da2d-09dc-407e-b319-7cc0d491ed46 tempest-CinderUnicodeTest-851630309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec" returned: 0 in 0.547s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3e92da2d-09dc-407e-b319-7cc0d491ed46 tempest-CinderUnicodeTest-851630309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.fece1b64-c4a5-4d56-8a17-dba8b19dc3dd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:43 devstack sudo[108183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.fece1b64-c4a5-4d56-8a17-dba8b19dc3dd
Sep 28 18:29:43 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:43 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a114118-30e6-4bb2-be98-9a2d66179482 1073741824" returned: 0 in 0.679s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:43 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a114118-30e6-4bb2-be98-9a2d66179482 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e907f7b0-703e-4c9a-9424-62bd67a401b0 tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-98223190-7b9e-42d8-bf0d-74c5fd45089d" returned: 0 in 0.335s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:43 devstack sudo[108186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a114118-30e6-4bb2-be98-9a2d66179482
Sep 28 18:29:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e907f7b0-703e-4c9a-9424-62bd67a401b0 tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Lock "cinder-quobyte-98223190-7b9e-42d8-bf0d-74c5fd45089d" released by "delete_volume" :: held 0.932s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:43 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:43 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-e907f7b0-703e-4c9a-9424-62bd67a401b0 tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Created reservations ['00987199-16af-4390-b9ca-b57cc93fbdc6', '8483e48d-c2f4-4045-9b5f-c595220de9b8', '70a446d3-8987-48c5-85e2-c315c81b9fe1', '20f28146-96bf-403a-b9e4-b75458077b44'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:29:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e907f7b0-703e-4c9a-9424-62bd67a401b0 tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e907f7b0-703e-4c9a-9424-62bd67a401b0 tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e907f7b0-703e-4c9a-9424-62bd67a401b0 tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e907f7b0-703e-4c9a-9424-62bd67a401b0 tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e907f7b0-703e-4c9a-9424-62bd67a401b0 tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e907f7b0-703e-4c9a-9424-62bd67a401b0 tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:43 devstack sudo[108192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:29:43 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:44 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3e92da2d-09dc-407e-b319-7cc0d491ed46 tempest-CinderUnicodeTest-851630309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.fece1b64-c4a5-4d56-8a17-dba8b19dc3dd" returned: 0 in 0.602s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3e92da2d-09dc-407e-b319-7cc0d491ed46 tempest-CinderUnicodeTest-851630309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.fece1b64-c4a5-4d56-8a17-dba8b19dc3dd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:44 devstack sudo[108194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.fece1b64-c4a5-4d56-8a17-dba8b19dc3dd
Sep 28 18:29:44 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:44 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a114118-30e6-4bb2-be98-9a2d66179482" returned: 0 in 0.508s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.831s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-979277397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c781470-f62d-46c1-a821-92307709c585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeb3f91dba041cf90cb0a77d65f7462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:40Z,use_quota=True,user_id='8b662392cce94af1afbb63c334c54a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Creating volume 1c781470-f62d-46c1-a821-92307709c585 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:29:44 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1c781470-f62d-46c1-a821-92307709c585 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f6f1fd0-65f2-480a-9bb8-f60fe0df1d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a114118-30e6-4bb2-be98-9a2d66179482', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ab888c-b284-4ba3-91b9-ddbeaf909673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:44 devstack sudo[108198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1c781470-f62d-46c1-a821-92307709c585 1073741824
Sep 28 18:29:44 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:44 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Volume volume-2a114118-30e6-4bb2-be98-9a2d66179482 (2a114118-30e6-4bb2-be98-9a2d66179482): created successfully
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ab888c-b284-4ba3-91b9-ddbeaf909673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Flow 'volume_create_manager' (448f5e11-9b92-4235-a464-dc13fd944385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:44 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:44 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-876dc9f2-f9e2-47f5-9d67-115d3370cf14 tempest-CreateVolumesFromSnapshotTest-859314465 None] Created volume successfully.
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e907f7b0-703e-4c9a-9424-62bd67a401b0 tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.435s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-e907f7b0-703e-4c9a-9424-62bd67a401b0 tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:29:44 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-e907f7b0-703e-4c9a-9424-62bd67a401b0 tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Deleted volume successfully.
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e907f7b0-703e-4c9a-9424-62bd67a401b0 tempest-VolumeAndVolumeTypeFromImageTest-225925967 None] Lock "cinder-98223190-7b9e-42d8-bf0d-74c5fd45089d-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:44 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3e92da2d-09dc-407e-b319-7cc0d491ed46 tempest-CinderUnicodeTest-851630309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec.fece1b64-c4a5-4d56-8a17-dba8b19dc3dd" returned: 0 in 0.350s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3e92da2d-09dc-407e-b319-7cc0d491ed46 tempest-CinderUnicodeTest-851630309 None] Lock "cinder-quobyte-fece1b64-c4a5-4d56-8a17-dba8b19dc3dd" released by "_delete_snapshot" :: held 2.175s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3e92da2d-09dc-407e-b319-7cc0d491ed46 tempest-CinderUnicodeTest-851630309 None] Lock "cinder-quobyte-1dafb08a-daa6-444d-9535-dcd835adafec" released by "delete_snapshot" :: held 2.213s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-3e92da2d-09dc-407e-b319-7cc0d491ed46 tempest-CinderUnicodeTest-851630309 None] Created reservations ['c5b23f61-6bd1-4a65-a2c5-bc6a2df960da', 'b52f9f7f-16fd-4881-82e3-f737dbf54bdc', 'a7c49f32-9e08-45f7-b89c-a49da7201ad7', '519f28d2-381c-4096-9ef2-b571ab48659b'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:29:44 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-3e92da2d-09dc-407e-b319-7cc0d491ed46 tempest-CinderUnicodeTest-851630309 None] Delete snapshot completed successfully.
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-3e92da2d-09dc-407e-b319-7cc0d491ed46 tempest-CinderUnicodeTest-851630309 None] Lock "cinder-fece1b64-c4a5-4d56-8a17-dba8b19dc3dd-delete_snapshot" released by "delete_snapshot" :: held 2.455s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:44 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1c781470-f62d-46c1-a821-92307709c585 1073741824" returned: 0 in 0.674s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1c781470-f62d-46c1-a821-92307709c585 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:44 devstack sudo[108206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1c781470-f62d-46c1-a821-92307709c585
Sep 28 18:29:44 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:45 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1c781470-f62d-46c1-a821-92307709c585" returned: 0 in 0.324s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.045s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1825365103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1096c7-0404-4b41-8e77-513178f5dec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeb3f91dba041cf90cb0a77d65f7462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:41Z,use_quota=True,user_id='8b662392cce94af1afbb63c334c54a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Creating volume cd1096c7-0404-4b41-8e77-513178f5dec4 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:29:45 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cd1096c7-0404-4b41-8e77-513178f5dec4 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74baecdf-0bbe-4835-b7d2-2b34beda77e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c781470-f62d-46c1-a821-92307709c585', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:45 devstack sudo[108209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cd1096c7-0404-4b41-8e77-513178f5dec4 1073741824
Sep 28 18:29:45 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a7644e-81f3-438b-99bf-53b0b55c6280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:45 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Volume volume-1c781470-f62d-46c1-a821-92307709c585 (1c781470-f62d-46c1-a821-92307709c585): created successfully
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a7644e-81f3-438b-99bf-53b0b55c6280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Flow 'volume_create_manager' (2e2e4441-346e-40e9-82fd-f5829cdad6e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:45 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-32bfd0d4-5e1c-4c9a-bf4b-e2a90710a8b7 tempest-CreateVolumesFromSnapshotTest-859314465 None] Created volume successfully.
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-72455872-5370-4996-82b7-ac46a40af853 tempest-CinderUnicodeTest-851630309 None] Acquiring lock "cinder-1dafb08a-daa6-444d-9535-dcd835adafec-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-72455872-5370-4996-82b7-ac46a40af853 tempest-CinderUnicodeTest-851630309 None] Lock "cinder-1dafb08a-daa6-444d-9535-dcd835adafec-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-72455872-5370-4996-82b7-ac46a40af853 tempest-CinderUnicodeTest-851630309 None] Acquiring lock "cinder-quobyte-1dafb08a-daa6-444d-9535-dcd835adafec" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-72455872-5370-4996-82b7-ac46a40af853 tempest-CinderUnicodeTest-851630309 None] Lock "cinder-quobyte-1dafb08a-daa6-444d-9535-dcd835adafec" acquired by "delete_volume" :: waited 0.021s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bb920a-0fbf-4cbb-8607-e63782fa078d]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-72455872-5370-4996-82b7-ac46a40af853 tempest-CinderUnicodeTest-851630309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:45 devstack sudo[108214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec
Sep 28 18:29:45 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:46 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cd1096c7-0404-4b41-8e77-513178f5dec4 1073741824" returned: 0 in 0.735s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cd1096c7-0404-4b41-8e77-513178f5dec4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:46 devstack sudo[108220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cd1096c7-0404-4b41-8e77-513178f5dec4
Sep 28 18:29:46 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:46 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-72455872-5370-4996-82b7-ac46a40af853 tempest-CinderUnicodeTest-851630309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec" returned: 0 in 0.594s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-72455872-5370-4996-82b7-ac46a40af853 tempest-CinderUnicodeTest-851630309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:46 devstack sudo[108226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec
Sep 28 18:29:46 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:46 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cd1096c7-0404-4b41-8e77-513178f5dec4" returned: 0 in 0.335s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.908s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-951810560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a829a5f-9678-46c5-a619-b0a83b36ba28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeb3f91dba041cf90cb0a77d65f7462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:41Z,use_quota=True,user_id='8b662392cce94af1afbb63c334c54a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Creating volume 2a829a5f-9678-46c5-a619-b0a83b36ba28 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:29:46 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a829a5f-9678-46c5-a619-b0a83b36ba28 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf02b331-0adf-4ad5-b7c6-32ed91819cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd1096c7-0404-4b41-8e77-513178f5dec4', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:46 devstack sudo[108229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a829a5f-9678-46c5-a619-b0a83b36ba28 1073741824
Sep 28 18:29:46 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab67970-2fd4-4dcd-a88d-9bc0e5d4c8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:46 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Volume volume-cd1096c7-0404-4b41-8e77-513178f5dec4 (cd1096c7-0404-4b41-8e77-513178f5dec4): created successfully
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab67970-2fd4-4dcd-a88d-9bc0e5d4c8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Flow 'volume_create_manager' (ab467cb4-cba8-428c-99ce-34a55b326771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:46 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-715817ab-8654-42d0-b15c-8dd5b8b5eb67 tempest-CreateVolumesFromSnapshotTest-859314465 None] Created volume successfully.
Sep 28 18:29:46 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-72455872-5370-4996-82b7-ac46a40af853 tempest-CinderUnicodeTest-851630309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1dafb08a-daa6-444d-9535-dcd835adafec" returned: 0 in 0.381s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-72455872-5370-4996-82b7-ac46a40af853 tempest-CinderUnicodeTest-851630309 None] Lock "cinder-quobyte-1dafb08a-daa6-444d-9535-dcd835adafec" released by "delete_volume" :: held 1.065s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-72455872-5370-4996-82b7-ac46a40af853 tempest-CinderUnicodeTest-851630309 None] Created reservations ['bc6b3a32-244e-4ef0-ba82-c61854fe8f13', '11419573-cbb7-40b9-821c-e7e56c297a19', 'da426b03-714f-46b6-908d-16267b0c5b3f', '345c4197-93a9-433e-a969-781f0ce533f9'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-72455872-5370-4996-82b7-ac46a40af853 tempest-CinderUnicodeTest-851630309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-72455872-5370-4996-82b7-ac46a40af853 tempest-CinderUnicodeTest-851630309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-72455872-5370-4996-82b7-ac46a40af853 tempest-CinderUnicodeTest-851630309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-72455872-5370-4996-82b7-ac46a40af853 tempest-CinderUnicodeTest-851630309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-72455872-5370-4996-82b7-ac46a40af853 tempest-CinderUnicodeTest-851630309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-72455872-5370-4996-82b7-ac46a40af853 tempest-CinderUnicodeTest-851630309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:46 devstack sudo[108235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:29:46 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:47 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a829a5f-9678-46c5-a619-b0a83b36ba28 1073741824" returned: 0 in 0.767s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:47 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-72455872-5370-4996-82b7-ac46a40af853 tempest-CinderUnicodeTest-851630309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.377s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:47 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-72455872-5370-4996-82b7-ac46a40af853 tempest-CinderUnicodeTest-851630309 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:29:47 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-72455872-5370-4996-82b7-ac46a40af853 tempest-CinderUnicodeTest-851630309 None] Deleted volume successfully.
Sep 28 18:29:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a829a5f-9678-46c5-a619-b0a83b36ba28 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:47 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-72455872-5370-4996-82b7-ac46a40af853 tempest-CinderUnicodeTest-851630309 None] Lock "cinder-1dafb08a-daa6-444d-9535-dcd835adafec-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:47 devstack sudo[108238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a829a5f-9678-46c5-a619-b0a83b36ba28
Sep 28 18:29:47 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:47 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a829a5f-9678-46c5-a619-b0a83b36ba28" returned: 0 in 0.294s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:29:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3a3a9a-d7f2-4660-acdf-0447d4bfb3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a829a5f-9678-46c5-a619-b0a83b36ba28', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf1c49a-c2a7-4335-930e-7b3e3fafc9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:47 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Volume volume-2a829a5f-9678-46c5-a619-b0a83b36ba28 (2a829a5f-9678-46c5-a619-b0a83b36ba28): created successfully
Sep 28 18:29:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf1c49a-c2a7-4335-930e-7b3e3fafc9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Flow 'volume_create_manager' (6c21c782-544c-493e-a8b7-ecd7cbea87c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:47 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-a910b98a-f131-45c3-9900-830c96dd0551 tempest-CreateVolumesFromSnapshotTest-859314465 None] Created volume successfully.
Sep 28 18:29:47 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-368fecb1-04f6-4a22-a6a0-3b47a6841ecc tempest-CinderUnicodeTest-851630309 None] Acquiring lock "cinder-0da44a27-42a8-4d35-950d-c7ea86482c2d-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:47 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-368fecb1-04f6-4a22-a6a0-3b47a6841ecc tempest-CinderUnicodeTest-851630309 None] Lock "cinder-0da44a27-42a8-4d35-950d-c7ea86482c2d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:47 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-368fecb1-04f6-4a22-a6a0-3b47a6841ecc tempest-CinderUnicodeTest-851630309 None] Acquiring lock "cinder-quobyte-0da44a27-42a8-4d35-950d-c7ea86482c2d" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:47 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-368fecb1-04f6-4a22-a6a0-3b47a6841ecc tempest-CinderUnicodeTest-851630309 None] Lock "cinder-quobyte-0da44a27-42a8-4d35-950d-c7ea86482c2d" acquired by "delete_volume" :: waited 0.029s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:48 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa63f980-ab9b-476a-952e-8ea422ce543d]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-368fecb1-04f6-4a22-a6a0-3b47a6841ecc tempest-CinderUnicodeTest-851630309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0da44a27-42a8-4d35-950d-c7ea86482c2d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:48 devstack sudo[108241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0da44a27-42a8-4d35-950d-c7ea86482c2d
Sep 28 18:29:48 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-95f01490-a896-4f25-aeca-9af21f431fb8 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "cinder-2a829a5f-9678-46c5-a619-b0a83b36ba28-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-95f01490-a896-4f25-aeca-9af21f431fb8 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-2a829a5f-9678-46c5-a619-b0a83b36ba28-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-95f01490-a896-4f25-aeca-9af21f431fb8 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "cinder-quobyte-2a829a5f-9678-46c5-a619-b0a83b36ba28" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-95f01490-a896-4f25-aeca-9af21f431fb8 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-quobyte-2a829a5f-9678-46c5-a619-b0a83b36ba28" acquired by "delete_volume" :: waited 0.027s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:48 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-368fecb1-04f6-4a22-a6a0-3b47a6841ecc tempest-CinderUnicodeTest-851630309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0da44a27-42a8-4d35-950d-c7ea86482c2d" returned: 0 in 0.507s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-368fecb1-04f6-4a22-a6a0-3b47a6841ecc tempest-CinderUnicodeTest-851630309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0da44a27-42a8-4d35-950d-c7ea86482c2d {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:48 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eb0f8a-c457-4b8c-bced-9d2c4bb703d5]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-95f01490-a896-4f25-aeca-9af21f431fb8 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a829a5f-9678-46c5-a619-b0a83b36ba28 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:48 devstack sudo[108246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0da44a27-42a8-4d35-950d-c7ea86482c2d
Sep 28 18:29:48 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:48 devstack sudo[108247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a829a5f-9678-46c5-a619-b0a83b36ba28
Sep 28 18:29:48 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:48 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-368fecb1-04f6-4a22-a6a0-3b47a6841ecc tempest-CinderUnicodeTest-851630309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0da44a27-42a8-4d35-950d-c7ea86482c2d" returned: 0 in 0.334s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-368fecb1-04f6-4a22-a6a0-3b47a6841ecc tempest-CinderUnicodeTest-851630309 None] Lock "cinder-quobyte-0da44a27-42a8-4d35-950d-c7ea86482c2d" released by "delete_volume" :: held 0.920s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:48 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-368fecb1-04f6-4a22-a6a0-3b47a6841ecc tempest-CinderUnicodeTest-851630309 None] Created reservations ['e78b231b-a31b-4f56-970a-635ac68b47e6', '47a7ada0-4e13-4bda-8960-dccbf861aaad', '3eaffb9c-76d0-4c87-9927-8f1cb5957534', '36290b2a-04fb-4bec-b73b-36c682dc3ead'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-368fecb1-04f6-4a22-a6a0-3b47a6841ecc tempest-CinderUnicodeTest-851630309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-368fecb1-04f6-4a22-a6a0-3b47a6841ecc tempest-CinderUnicodeTest-851630309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-368fecb1-04f6-4a22-a6a0-3b47a6841ecc tempest-CinderUnicodeTest-851630309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-368fecb1-04f6-4a22-a6a0-3b47a6841ecc tempest-CinderUnicodeTest-851630309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-368fecb1-04f6-4a22-a6a0-3b47a6841ecc tempest-CinderUnicodeTest-851630309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-368fecb1-04f6-4a22-a6a0-3b47a6841ecc tempest-CinderUnicodeTest-851630309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:49 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:49 devstack sudo[108254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:29:49 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-95f01490-a896-4f25-aeca-9af21f431fb8 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a829a5f-9678-46c5-a619-b0a83b36ba28" returned: 0 in 0.554s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-95f01490-a896-4f25-aeca-9af21f431fb8 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a829a5f-9678-46c5-a619-b0a83b36ba28 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:49 devstack sudo[108256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a829a5f-9678-46c5-a619-b0a83b36ba28
Sep 28 18:29:49 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:49 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-368fecb1-04f6-4a22-a6a0-3b47a6841ecc tempest-CinderUnicodeTest-851630309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.300s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-368fecb1-04f6-4a22-a6a0-3b47a6841ecc tempest-CinderUnicodeTest-851630309 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:29:49 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-368fecb1-04f6-4a22-a6a0-3b47a6841ecc tempest-CinderUnicodeTest-851630309 None] Deleted volume successfully.
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-368fecb1-04f6-4a22-a6a0-3b47a6841ecc tempest-CinderUnicodeTest-851630309 None] Lock "cinder-0da44a27-42a8-4d35-950d-c7ea86482c2d-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:49 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-95f01490-a896-4f25-aeca-9af21f431fb8 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a829a5f-9678-46c5-a619-b0a83b36ba28" returned: 0 in 0.305s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-95f01490-a896-4f25-aeca-9af21f431fb8 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-quobyte-2a829a5f-9678-46c5-a619-b0a83b36ba28" released by "delete_volume" :: held 0.933s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-95f01490-a896-4f25-aeca-9af21f431fb8 tempest-CreateVolumesFromSnapshotTest-859314465 None] Created reservations ['fccd42c3-f4cc-4b29-bcbd-756b6bee244b', '6ac3287f-167c-4876-9968-d1746548dad5', 'af505620-0edc-44fd-8bbc-71c4e3c75c33', '3411bcc4-0caa-4f48-b62c-1e10a9d47562'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-95f01490-a896-4f25-aeca-9af21f431fb8 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-95f01490-a896-4f25-aeca-9af21f431fb8 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-95f01490-a896-4f25-aeca-9af21f431fb8 tempest-CreateVolumesFromSnapshotTest-859314465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-95f01490-a896-4f25-aeca-9af21f431fb8 tempest-CreateVolumesFromSnapshotTest-859314465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-95f01490-a896-4f25-aeca-9af21f431fb8 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-95f01490-a896-4f25-aeca-9af21f431fb8 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:49 devstack sudo[108260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:29:49 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9638a647-9764-46df-92f0-0ece19fb119d tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "cinder-cd1096c7-0404-4b41-8e77-513178f5dec4-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9638a647-9764-46df-92f0-0ece19fb119d tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-cd1096c7-0404-4b41-8e77-513178f5dec4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9638a647-9764-46df-92f0-0ece19fb119d tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "cinder-quobyte-cd1096c7-0404-4b41-8e77-513178f5dec4" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9638a647-9764-46df-92f0-0ece19fb119d tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-quobyte-cd1096c7-0404-4b41-8e77-513178f5dec4" acquired by "delete_volume" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[016c7ed1-c396-4175-8117-088bb0898a15]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9638a647-9764-46df-92f0-0ece19fb119d tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cd1096c7-0404-4b41-8e77-513178f5dec4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:49 devstack sudo[108262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cd1096c7-0404-4b41-8e77-513178f5dec4
Sep 28 18:29:49 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:50 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-95f01490-a896-4f25-aeca-9af21f431fb8 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.475s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:50 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-95f01490-a896-4f25-aeca-9af21f431fb8 tempest-CreateVolumesFromSnapshotTest-859314465 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:29:50 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-95f01490-a896-4f25-aeca-9af21f431fb8 tempest-CreateVolumesFromSnapshotTest-859314465 None] Deleted volume successfully.
Sep 28 18:29:50 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-95f01490-a896-4f25-aeca-9af21f431fb8 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-2a829a5f-9678-46c5-a619-b0a83b36ba28-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:50 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9638a647-9764-46df-92f0-0ece19fb119d tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cd1096c7-0404-4b41-8e77-513178f5dec4" returned: 0 in 0.538s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9638a647-9764-46df-92f0-0ece19fb119d tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cd1096c7-0404-4b41-8e77-513178f5dec4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:50 devstack sudo[108268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cd1096c7-0404-4b41-8e77-513178f5dec4
Sep 28 18:29:50 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:50 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9638a647-9764-46df-92f0-0ece19fb119d tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cd1096c7-0404-4b41-8e77-513178f5dec4" returned: 0 in 0.321s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:50 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9638a647-9764-46df-92f0-0ece19fb119d tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-quobyte-cd1096c7-0404-4b41-8e77-513178f5dec4" released by "delete_volume" :: held 0.923s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:50 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-9638a647-9764-46df-92f0-0ece19fb119d tempest-CreateVolumesFromSnapshotTest-859314465 None] Created reservations ['87160457-9705-4515-8476-4ab444ad3a37', '5a750928-c331-4e03-9f50-81871a1860e6', 'c60f2257-e803-46af-be5b-fca2f06c55c2', 'c3e78c2a-e5bf-422a-af63-9321c8bfde9b'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:29:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9638a647-9764-46df-92f0-0ece19fb119d tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9638a647-9764-46df-92f0-0ece19fb119d tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9638a647-9764-46df-92f0-0ece19fb119d tempest-CreateVolumesFromSnapshotTest-859314465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9638a647-9764-46df-92f0-0ece19fb119d tempest-CreateVolumesFromSnapshotTest-859314465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9638a647-9764-46df-92f0-0ece19fb119d tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9638a647-9764-46df-92f0-0ece19fb119d tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:51 devstack sudo[108271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:29:51 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8d42fe21-5316-4d10-89c6-c974123bb4c2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "cinder-1c781470-f62d-46c1-a821-92307709c585-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Flow 'volume_create_manager' (51a720bc-2fde-40df-ab68-94f0bc387674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9c3851-94aa-43e0-b755-e8c3430de6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8d42fe21-5316-4d10-89c6-c974123bb4c2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-1c781470-f62d-46c1-a821-92307709c585-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9c3851-94aa-43e0-b755-e8c3430de6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec0a61c-7cd3-4a83-afd8-4b0edb27de13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f67c2772e7594bb1a8df57c06b02d101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:51Z,use_quota=True,user_id='19a466147cbf437b98f688dfe5fcf30b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a36d193-bb93-4118-bd99-e6dc5ab699b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a36d193-bb93-4118-bd99-e6dc5ab699b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2348d9bd-b1de-4bf0-96ae-f2541e1c3e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.image.glance [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Creating Keystone auth plugin from conf {{(pid=87046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 28 18:29:51 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9638a647-9764-46df-92f0-0ece19fb119d tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.392s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-9638a647-9764-46df-92f0-0ece19fb119d tempest-CreateVolumesFromSnapshotTest-859314465 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:29:51 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-9638a647-9764-46df-92f0-0ece19fb119d tempest-CreateVolumesFromSnapshotTest-859314465 None] Deleted volume successfully.
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8d42fe21-5316-4d10-89c6-c974123bb4c2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "cinder-quobyte-1c781470-f62d-46c1-a821-92307709c585" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8d42fe21-5316-4d10-89c6-c974123bb4c2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-quobyte-1c781470-f62d-46c1-a821-92307709c585" acquired by "delete_volume" :: waited 0.033s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9638a647-9764-46df-92f0-0ece19fb119d tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-cd1096c7-0404-4b41-8e77-513178f5dec4-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f4dcf4-4768-479e-8bab-35a61f2fb615]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8d42fe21-5316-4d10-89c6-c974123bb4c2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1c781470-f62d-46c1-a821-92307709c585 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:51 devstack sudo[108274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1c781470-f62d-46c1-a821-92307709c585
Sep 28 18:29:51 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Flow 'volume_create_manager' (9d13fa24-7f70-4144-8b35-cde914cd4d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff168258-8160-4c25-8271-a984e3f788bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff168258-8160-4c25-8271-a984e3f788bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1717931012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc23dc4b-a4a5-40e3-af81-0e16a8088bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4aad29167d4552b13d37e69bc708ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:52Z,use_quota=True,user_id='2efde6e44baa43cf963c426d24ca92d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ce9a15-b1f1-47ff-b0d3-fdc75e91efdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ce9a15-b1f1-47ff-b0d3-fdc75e91efdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca8ce4a-d178-432d-a8ae-df5a208fdd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca8ce4a-d178-432d-a8ae-df5a208fdd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc23dc4b-a4a5-40e3-af81-0e16a8088bec', 'volume_name': 'volume-cc23dc4b-a4a5-40e3-af81-0e16a8088bec', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9738bc4c-bbe8-409e-9ab4-998c4ff4b848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9738bc4c-bbe8-409e-9ab4-998c4ff4b848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5297a630-a723-44e4-a307-fdb86ea23a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:51 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Volume cc23dc4b-a4a5-40e3-af81-0e16a8088bec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc23dc4b-a4a5-40e3-af81-0e16a8088bec', 'volume_size': 1}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1717931012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc23dc4b-a4a5-40e3-af81-0e16a8088bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4aad29167d4552b13d37e69bc708ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:52Z,use_quota=True,user_id='2efde6e44baa43cf963c426d24ca92d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Creating volume cc23dc4b-a4a5-40e3-af81-0e16a8088bec {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:29:51 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc23dc4b-a4a5-40e3-af81-0e16a8088bec 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:51 devstack sudo[108277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc23dc4b-a4a5-40e3-af81-0e16a8088bec 1073741824
Sep 28 18:29:51 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2348d9bd-b1de-4bf0-96ae-f2541e1c3e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aec0a61c-7cd3-4a83-afd8-4b0edb27de13', 'volume_name': 'volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13', 'volume_size': 1, 'image_id': '86b3d5e9-29ab-4230-a8c4-33c49461799f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86b3d5e9-29ab-4230-a8c4-33c49461799f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0c5cbd0af42b76afb7225d05d92e12b0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f67c2772e7594bb1a8df57c06b02d101', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a83bce2b876d4e017ee4afe82a391f1585c0cd7d836c0d87065452f2336be76271f59411bc4ebac18e1650da53ddbe7cc32b1aa7c45a444063129586e2187b86', 'id': '86b3d5e9-29ab-4230-a8c4-33c49461799f', 'created_at': datetime.datetime(2026, 9, 28, 16, 29, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 29, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86b3d5e9-29ab-4230-a8c4-33c49461799f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aa4a67d10>}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78665b1-8ddd-44f2-b11c-f84f7f22a592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78665b1-8ddd-44f2-b11c-f84f7f22a592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:51 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46863f6e-ed10-42b4-811e-7d7bf34aeb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:51 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Volume aec0a61c-7cd3-4a83-afd8-4b0edb27de13: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13', 'volume_size': 1, 'image_id': '86b3d5e9-29ab-4230-a8c4-33c49461799f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86b3d5e9-29ab-4230-a8c4-33c49461799f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0c5cbd0af42b76afb7225d05d92e12b0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f67c2772e7594bb1a8df57c06b02d101', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a83bce2b876d4e017ee4afe82a391f1585c0cd7d836c0d87065452f2336be76271f59411bc4ebac18e1650da53ddbe7cc32b1aa7c45a444063129586e2187b86', 'id': '86b3d5e9-29ab-4230-a8c4-33c49461799f', 'created_at': datetime.datetime(2026, 9, 28, 16, 29, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 29, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86b3d5e9-29ab-4230-a8c4-33c49461799f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aa4a67d10>}
Sep 28 18:29:51 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Trying to clone aec0a61c-7cd3-4a83-afd8-4b0edb27de13 from image 86b3d5e9-29ab-4230-a8c4-33c49461799f at location (None, [{'url': 'file:///opt/stack/data/glance/images/86b3d5e9-29ab-4230-a8c4-33c49461799f', 'metadata': {}}]). {{(pid=87046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8d42fe21-5316-4d10-89c6-c974123bb4c2 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1c781470-f62d-46c1-a821-92307709c585" returned: 0 in 0.483s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8d42fe21-5316-4d10-89c6-c974123bb4c2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1c781470-f62d-46c1-a821-92307709c585 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:52 devstack sudo[108281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1c781470-f62d-46c1-a821-92307709c585
Sep 28 18:29:52 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 28 18:29:52 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Image download 0.00 MB at 0.00 MB/s
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c775db9-1493-421f-93b2-655a07e67059]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:52 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8d42fe21-5316-4d10-89c6-c974123bb4c2 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1c781470-f62d-46c1-a821-92307709c585" returned: 0 in 0.343s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:52 devstack sudo[108285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD
Sep 28 18:29:52 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8d42fe21-5316-4d10-89c6-c974123bb4c2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-quobyte-1c781470-f62d-46c1-a821-92307709c585" released by "delete_volume" :: held 0.915s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-8d42fe21-5316-4d10-89c6-c974123bb4c2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Created reservations ['6b488dfe-2ba3-49ab-9e28-2104c7c3d204', '629ea478-db6f-4979-9d25-6ce0822649bd', '813e3546-5a1c-4ce2-af10-7c2c97aaa0d0', '7857d437-4997-44e1-8d34-fb3d392f2660'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:29:52 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc23dc4b-a4a5-40e3-af81-0e16a8088bec 1073741824" returned: 0 in 0.636s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8d42fe21-5316-4d10-89c6-c974123bb4c2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8d42fe21-5316-4d10-89c6-c974123bb4c2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8d42fe21-5316-4d10-89c6-c974123bb4c2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8d42fe21-5316-4d10-89c6-c974123bb4c2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8d42fe21-5316-4d10-89c6-c974123bb4c2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8d42fe21-5316-4d10-89c6-c974123bb4c2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc23dc4b-a4a5-40e3-af81-0e16a8088bec {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:52 devstack sudo[108290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:29:52 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:52 devstack sudo[108291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc23dc4b-a4a5-40e3-af81-0e16a8088bec
Sep 28 18:29:52 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:52 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD" returned: 0 in 0.494s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:52 devstack sudo[108296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD
Sep 28 18:29:52 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:52 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc23dc4b-a4a5-40e3-af81-0e16a8088bec" returned: 0 in 0.309s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5297a630-a723-44e4-a307-fdb86ea23a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc23dc4b-a4a5-40e3-af81-0e16a8088bec', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:52 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef9f7857-b3f5-402c-8d9d-9cb522bbdb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8d42fe21-5316-4d10-89c6-c974123bb4c2 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.367s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-8d42fe21-5316-4d10-89c6-c974123bb4c2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:29:52 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-8d42fe21-5316-4d10-89c6-c974123bb4c2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Deleted volume successfully.
Sep 28 18:29:52 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Volume volume-cc23dc4b-a4a5-40e3-af81-0e16a8088bec (cc23dc4b-a4a5-40e3-af81-0e16a8088bec): created successfully
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef9f7857-b3f5-402c-8d9d-9cb522bbdb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Flow 'volume_create_manager' (9d13fa24-7f70-4144-8b35-cde914cd4d71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:52 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-585f4e27-897d-4e09-868a-6980fdeb535e tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Created volume successfully.
Sep 28 18:29:52 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8d42fe21-5316-4d10-89c6-c974123bb4c2 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-1c781470-f62d-46c1-a821-92307709c585-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:53 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD" returned: 1 in 0.404s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Temporary image 86b3d5e9-29ab-4230-a8c4-33c49461799f is fetched for user 19a466147cbf437b98f688dfe5fcf30b. {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b088a2bf-3c92-4a5a-a387-a1c6ff3e4c46]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:53 devstack sudo[108303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD
Sep 28 18:29:53 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6cf906f5-fcc4-45dc-9349-bf9c8e53e887 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "cinder-2a114118-30e6-4bb2-be98-9a2d66179482-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6cf906f5-fcc4-45dc-9349-bf9c8e53e887 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-2a114118-30e6-4bb2-be98-9a2d66179482-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:53 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6cf906f5-fcc4-45dc-9349-bf9c8e53e887 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "cinder-quobyte-2a114118-30e6-4bb2-be98-9a2d66179482" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6cf906f5-fcc4-45dc-9349-bf9c8e53e887 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-quobyte-2a114118-30e6-4bb2-be98-9a2d66179482" acquired by "delete_volume" :: waited 0.025s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[de617f46-bcf2-472d-9935-0959c53c0872]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cf906f5-fcc4-45dc-9349-bf9c8e53e887 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a114118-30e6-4bb2-be98-9a2d66179482 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:53 devstack sudo[108308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD
Sep 28 18:29:53 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:53 devstack sudo[108309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a114118-30e6-4bb2-be98-9a2d66179482
Sep 28 18:29:53 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:53 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD" returned: 1 in 0.375s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec0a61c-7cd3-4a83-afd8-4b0edb27de13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f67c2772e7594bb1a8df57c06b02d101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:51Z,use_quota=True,user_id='19a466147cbf437b98f688dfe5fcf30b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Creating volume aec0a61c-7cd3-4a83-afd8-4b0edb27de13 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:29:53 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:29:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:54 devstack sudo[108315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13 1073741824
Sep 28 18:29:54 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:54 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cf906f5-fcc4-45dc-9349-bf9c8e53e887 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a114118-30e6-4bb2-be98-9a2d66179482" returned: 0 in 0.452s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cf906f5-fcc4-45dc-9349-bf9c8e53e887 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a114118-30e6-4bb2-be98-9a2d66179482 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:54 devstack sudo[108320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a114118-30e6-4bb2-be98-9a2d66179482
Sep 28 18:29:54 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:29:54 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Flow 'volume_create_manager' (8b683711-3c88-4c0d-9bb2-e28e41c2cdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7741d3-84ca-456a-ac2f-46500a9647db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cf906f5-fcc4-45dc-9349-bf9c8e53e887 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-2a114118-30e6-4bb2-be98-9a2d66179482" returned: 0 in 0.341s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7741d3-84ca-456a-ac2f-46500a9647db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-725087244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f964ea2-46e2-41e4-84bf-40b76f5dee26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4aad29167d4552b13d37e69bc708ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:54Z,use_quota=True,user_id='2efde6e44baa43cf963c426d24ca92d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6619fec-1f57-4944-875d-222a02500636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6619fec-1f57-4944-875d-222a02500636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb4c143-a326-47ee-8443-8f8c24275aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb4c143-a326-47ee-8443-8f8c24275aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f964ea2-46e2-41e4-84bf-40b76f5dee26', 'volume_name': 'volume-1f964ea2-46e2-41e4-84bf-40b76f5dee26', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605976d7-2fce-4864-a8b2-34030091e6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605976d7-2fce-4864-a8b2-34030091e6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c3a1f6-5340-4ea0-9970-f9c638fc6659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:54 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Volume 1f964ea2-46e2-41e4-84bf-40b76f5dee26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f964ea2-46e2-41e4-84bf-40b76f5dee26', 'volume_size': 1}
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6cf906f5-fcc4-45dc-9349-bf9c8e53e887 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-quobyte-2a114118-30e6-4bb2-be98-9a2d66179482" released by "delete_volume" :: held 0.906s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:54 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13 1073741824" returned: 0 in 0.588s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-6cf906f5-fcc4-45dc-9349-bf9c8e53e887 tempest-CreateVolumesFromSnapshotTest-859314465 None] Created reservations ['12d434a1-00ec-466a-92f4-7062d79e2270', 'ca0e2271-f96c-413c-83a2-36142736f961', '9beb5f48-f0d8-4379-a29f-936e5691e5d8', '0eb34876-fca8-4079-b9a9-0579adbffe40'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:29:54 devstack sudo[108327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13
Sep 28 18:29:54 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6cf906f5-fcc4-45dc-9349-bf9c8e53e887 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6cf906f5-fcc4-45dc-9349-bf9c8e53e887 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6cf906f5-fcc4-45dc-9349-bf9c8e53e887 tempest-CreateVolumesFromSnapshotTest-859314465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6cf906f5-fcc4-45dc-9349-bf9c8e53e887 tempest-CreateVolumesFromSnapshotTest-859314465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6cf906f5-fcc4-45dc-9349-bf9c8e53e887 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cf906f5-fcc4-45dc-9349-bf9c8e53e887 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:54 devstack sudo[108329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:29:54 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Flow 'volume_create_manager' (4f45a46f-c607-4e48-a9db-9d61a098b129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:54 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a44130-a911-4334-a55a-c5839bb172c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:55 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13" returned: 0 in 0.396s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.468s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-725087244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f964ea2-46e2-41e4-84bf-40b76f5dee26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4aad29167d4552b13d37e69bc708ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:54Z,use_quota=True,user_id='2efde6e44baa43cf963c426d24ca92d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Creating volume 1f964ea2-46e2-41e4-84bf-40b76f5dee26 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:29:55 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f964ea2-46e2-41e4-84bf-40b76f5dee26 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a44130-a911-4334-a55a-c5839bb172c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1950522308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2fc7af6-f55c-417c-ac41-14f6b122fd10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4aad29167d4552b13d37e69bc708ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:55Z,use_quota=True,user_id='2efde6e44baa43cf963c426d24ca92d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959dfe97-dca4-49b2-9e9b-a69ee0724e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959dfe97-dca4-49b2-9e9b-a69ee0724e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:55 devstack sudo[108332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f964ea2-46e2-41e4-84bf-40b76f5dee26 1073741824
Sep 28 18:29:55 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a6a2a8-4b57-4cf8-8946-5af925a7efa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a6a2a8-4b57-4cf8-8946-5af925a7efa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2fc7af6-f55c-417c-ac41-14f6b122fd10', 'volume_name': 'volume-e2fc7af6-f55c-417c-ac41-14f6b122fd10', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca701e5-ff3b-4a1b-90cd-527bdef3350f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca701e5-ff3b-4a1b-90cd-527bdef3350f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba5bfe6-2476-40e3-b5fd-24ec76baa1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:55 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Volume e2fc7af6-f55c-417c-ac41-14f6b122fd10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2fc7af6-f55c-417c-ac41-14f6b122fd10', 'volume_size': 1}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:55 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cf906f5-fcc4-45dc-9349-bf9c8e53e887 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.410s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-6cf906f5-fcc4-45dc-9349-bf9c8e53e887 tempest-CreateVolumesFromSnapshotTest-859314465 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:29:55 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-6cf906f5-fcc4-45dc-9349-bf9c8e53e887 tempest-CreateVolumesFromSnapshotTest-859314465 None] Deleted volume successfully.
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Attempting download of 86b3d5e9-29ab-4230-a8c4-33c49461799f ((None, [{'url': 'file:///opt/stack/data/glance/images/86b3d5e9-29ab-4230-a8c4-33c49461799f', 'metadata': {}}])) to volume aec0a61c-7cd3-4a83-afd8-4b0edb27de13. {{(pid=87046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6cf906f5-fcc4-45dc-9349-bf9c8e53e887 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-2a114118-30e6-4bb2-be98-9a2d66179482-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab753095-a89f-449d-8053-98b9c849f8d5]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86b3d5e9-29ab-4230-a8c4-33c49461799f_88god8qs {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:55 devstack sudo[108335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86b3d5e9-29ab-4230-a8c4-33c49461799f_88god8qs
Sep 28 18:29:55 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Flow 'volume_create_manager' (194aac92-8a2e-4b02-b5bc-28425d45d447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8369d352-f0dd-4487-8f15-ba6a8b4372b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8369d352-f0dd-4487-8f15-ba6a8b4372b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-500099661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b66f47-2618-447c-b1b2-2e9e2d5cf906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4aad29167d4552b13d37e69bc708ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:55Z,use_quota=True,user_id='2efde6e44baa43cf963c426d24ca92d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac615d38-b08c-4576-b070-769768f7c227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac615d38-b08c-4576-b070-769768f7c227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c4f0d74-de84-4133-8c06-93f61bdf4655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c4f0d74-de84-4133-8c06-93f61bdf4655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8b66f47-2618-447c-b1b2-2e9e2d5cf906', 'volume_name': 'volume-e8b66f47-2618-447c-b1b2-2e9e2d5cf906', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9085fc0-1fdd-4b38-896f-6ce3702e8d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9085fc0-1fdd-4b38-896f-6ce3702e8d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (161cf90b-3af5-4a52-b286-ff48d1aee07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:55 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Volume e8b66f47-2618-447c-b1b2-2e9e2d5cf906: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8b66f47-2618-447c-b1b2-2e9e2d5cf906', 'volume_size': 1}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:55 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:55 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f964ea2-46e2-41e4-84bf-40b76f5dee26 1073741824" returned: 0 in 0.723s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86b3d5e9-29ab-4230-a8c4-33c49461799f_88god8qs" returned: 0 in 0.480s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86b3d5e9-29ab-4230-a8c4-33c49461799f_88god8qs {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f964ea2-46e2-41e4-84bf-40b76f5dee26 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:55 devstack sudo[108344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f964ea2-46e2-41e4-84bf-40b76f5dee26
Sep 28 18:29:55 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:55 devstack sudo[108343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86b3d5e9-29ab-4230-a8c4-33c49461799f_88god8qs
Sep 28 18:29:55 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d6cc588d-15c5-4872-8f15-e997804c56df tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "cinder-5648998b-0366-46ff-8ddb-d3ca08a682b2-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d6cc588d-15c5-4872-8f15-e997804c56df tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-5648998b-0366-46ff-8ddb-d3ca08a682b2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:56 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86b3d5e9-29ab-4230-a8c4-33c49461799f_88god8qs" returned: 1 in 0.485s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86b3d5e9-29ab-4230-a8c4-33c49461799f_88god8qs' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:29:56 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee9ffe7-7ca6-4de9-bfc5-b3c197cb66de]: (4, 'raw') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d6cc588d-15c5-4872-8f15-e997804c56df tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "cinder-quobyte-5648998b-0366-46ff-8ddb-d3ca08a682b2" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f964ea2-46e2-41e4-84bf-40b76f5dee26" returned: 0 in 0.466s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.154s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1950522308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2fc7af6-f55c-417c-ac41-14f6b122fd10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4aad29167d4552b13d37e69bc708ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:55Z,use_quota=True,user_id='2efde6e44baa43cf963c426d24ca92d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Creating volume e2fc7af6-f55c-417c-ac41-14f6b122fd10 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:29:56 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e2fc7af6-f55c-417c-ac41-14f6b122fd10 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d6cc588d-15c5-4872-8f15-e997804c56df tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-quobyte-5648998b-0366-46ff-8ddb-d3ca08a682b2" acquired by "delete_volume" :: waited 0.082s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:56 devstack sudo[108351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e2fc7af6-f55c-417c-ac41-14f6b122fd10 1073741824
Sep 28 18:29:56 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c3a1f6-5340-4ea0-9970-f9c638fc6659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f964ea2-46e2-41e4-84bf-40b76f5dee26', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb00750c-015d-4b31-b0b2-b1447d3f552e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd55eab-a56a-4f72-b0c5-741f2669afb4]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d6cc588d-15c5-4872-8f15-e997804c56df tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5648998b-0366-46ff-8ddb-d3ca08a682b2 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:56 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Volume volume-1f964ea2-46e2-41e4-84bf-40b76f5dee26 (1f964ea2-46e2-41e4-84bf-40b76f5dee26): created successfully
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb00750c-015d-4b31-b0b2-b1447d3f552e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:56 devstack sudo[108350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD
Sep 28 18:29:56 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Flow 'volume_create_manager' (8b683711-3c88-4c0d-9bb2-e28e41c2cdd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Flow 'volume_create_manager' (27c583b0-8522-42f8-b5eb-646938820c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e6ae88b-7ac9-4180-bf15-14cd9dbc4632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:56 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-81df91c5-a241-4d34-ab22-61e8dc0da895 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Created volume successfully.
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e6ae88b-7ac9-4180-bf15-14cd9dbc4632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1253837216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e39c82-98af-4264-9753-3a3116dc4b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4aad29167d4552b13d37e69bc708ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:56Z,use_quota=True,user_id='2efde6e44baa43cf963c426d24ca92d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d943451-6436-4e83-a52c-137e9228866a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d943451-6436-4e83-a52c-137e9228866a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:56 devstack sudo[108353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5648998b-0366-46ff-8ddb-d3ca08a682b2
Sep 28 18:29:56 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d36878-b480-4c8a-8ccd-816bea09f4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d36878-b480-4c8a-8ccd-816bea09f4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18e39c82-98af-4264-9753-3a3116dc4b37', 'volume_name': 'volume-18e39c82-98af-4264-9753-3a3116dc4b37', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eaae151-d411-4b67-8f3c-a5dce974ad3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eaae151-d411-4b67-8f3c-a5dce974ad3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f70a8f-c075-4351-9235-a91e92d8093c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:56 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Volume 18e39c82-98af-4264-9753-3a3116dc4b37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18e39c82-98af-4264-9753-3a3116dc4b37', 'volume_size': 1}
Sep 28 18:29:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:57 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD" returned: 0 in 0.767s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:57 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e2fc7af6-f55c-417c-ac41-14f6b122fd10 1073741824" returned: 0 in 0.748s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:57 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d6cc588d-15c5-4872-8f15-e997804c56df tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5648998b-0366-46ff-8ddb-d3ca08a682b2" returned: 0 in 0.649s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d6cc588d-15c5-4872-8f15-e997804c56df tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5648998b-0366-46ff-8ddb-d3ca08a682b2 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:57 devstack sudo[108366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5648998b-0366-46ff-8ddb-d3ca08a682b2
Sep 28 18:29:57 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e2fc7af6-f55c-417c-ac41-14f6b122fd10 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:29:57 devstack sudo[108368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e2fc7af6-f55c-417c-ac41-14f6b122fd10
Sep 28 18:29:57 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Flow 'volume_create_manager' (630e13b3-b68f-4980-ba48-004d18a34d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1120a2d3-5212-461a-94ec-d87c0394d602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:57 devstack sudo[108365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD
Sep 28 18:29:57 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1120a2d3-5212-461a-94ec-d87c0394d602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1694798553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d54add4-d5f9-4954-a24e-63e4cae7baf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4aad29167d4552b13d37e69bc708ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:57Z,use_quota=True,user_id='2efde6e44baa43cf963c426d24ca92d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd45d60a-157f-4dde-8fdd-4de929b181f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd45d60a-157f-4dde-8fdd-4de929b181f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf581ae-462e-4e56-98d0-1360d38a52fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf581ae-462e-4e56-98d0-1360d38a52fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d54add4-d5f9-4954-a24e-63e4cae7baf0', 'volume_name': 'volume-4d54add4-d5f9-4954-a24e-63e4cae7baf0', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e619ee7-b1e5-4bc8-ad78-fae27e9e3cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e619ee7-b1e5-4bc8-ad78-fae27e9e3cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3ebdc6-a5a5-4905-8ed0-888c412f54ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:57 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Volume 4d54add4-d5f9-4954-a24e-63e4cae7baf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d54add4-d5f9-4954-a24e-63e4cae7baf0', 'volume_size': 1}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:57 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d6cc588d-15c5-4872-8f15-e997804c56df tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5648998b-0366-46ff-8ddb-d3ca08a682b2" returned: 0 in 0.318s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:57 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e2fc7af6-f55c-417c-ac41-14f6b122fd10" returned: 0 in 0.308s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.776s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-500099661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b66f47-2618-447c-b1b2-2e9e2d5cf906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4aad29167d4552b13d37e69bc708ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:55Z,use_quota=True,user_id='2efde6e44baa43cf963c426d24ca92d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Creating volume e8b66f47-2618-447c-b1b2-2e9e2d5cf906 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:29:57 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e8b66f47-2618-447c-b1b2-2e9e2d5cf906 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:57 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d6cc588d-15c5-4872-8f15-e997804c56df tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-quobyte-5648998b-0366-46ff-8ddb-d3ca08a682b2" released by "delete_volume" :: held 1.124s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD" returned: 1 in 0.466s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] 86b3d5e9-29ab-4230-a8c4-33c49461799f was raw, converting to qcow2 {{(pid=87046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 28 18:29:57 devstack sudo[108376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e8b66f47-2618-447c-b1b2-2e9e2d5cf906 1073741824
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:57 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba5bfe6-2476-40e3-b5fd-24ec76baa1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2fc7af6-f55c-417c-ac41-14f6b122fd10', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f2c24a-ceb4-4890-8eac-be83f7e8b6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:57 devstack sudo[108378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13
Sep 28 18:29:57 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:57 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Volume volume-e2fc7af6-f55c-417c-ac41-14f6b122fd10 (e2fc7af6-f55c-417c-ac41-14f6b122fd10): created successfully
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f2c24a-ceb4-4890-8eac-be83f7e8b6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Flow 'volume_create_manager' (4f45a46f-c607-4e48-a9db-9d61a098b129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:57 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d3daf70a-d5fd-47d2-8d85-0e52a7b5f857 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Created volume successfully.
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-d6cc588d-15c5-4872-8f15-e997804c56df tempest-CreateVolumesFromSnapshotTest-859314465 None] Created reservations ['fbbd6148-3f33-40a3-9496-023f19067f0d', 'd04c3a75-bc5d-4baf-ba46-d1aaefc77911', '1cf919a4-98e2-42e7-81d0-8e3011507468', 'c4bad2ab-377a-4c49-857a-7ba63a8939ce'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d6cc588d-15c5-4872-8f15-e997804c56df tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d6cc588d-15c5-4872-8f15-e997804c56df tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d6cc588d-15c5-4872-8f15-e997804c56df tempest-CreateVolumesFromSnapshotTest-859314465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d6cc588d-15c5-4872-8f15-e997804c56df tempest-CreateVolumesFromSnapshotTest-859314465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d6cc588d-15c5-4872-8f15-e997804c56df tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d6cc588d-15c5-4872-8f15-e997804c56df tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:57 devstack sudo[108383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:29:57 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:58 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e8b66f47-2618-447c-b1b2-2e9e2d5cf906 1073741824" returned: 0 in 0.559s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e8b66f47-2618-447c-b1b2-2e9e2d5cf906 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:58 devstack sudo[108390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e8b66f47-2618-447c-b1b2-2e9e2d5cf906
Sep 28 18:29:58 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:58 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d6cc588d-15c5-4872-8f15-e997804c56df tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.404s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d6cc588d-15c5-4872-8f15-e997804c56df tempest-CreateVolumesFromSnapshotTest-859314465 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:29:58 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d6cc588d-15c5-4872-8f15-e997804c56df tempest-CreateVolumesFromSnapshotTest-859314465 None] Deleted volume successfully.
Sep 28 18:29:58 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13" returned: 0 in 0.713s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_86b3d5e9-29ab-4230-a8c4-33c49461799f__57kpttndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13 {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:29:58 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Converted 0.00 MB image at 0.00 MB/s
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d6cc588d-15c5-4872-8f15-e997804c56df tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-5648998b-0366-46ff-8ddb-d3ca08a682b2-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:29:58 devstack sudo[108394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13 1G
Sep 28 18:29:58 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:58 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e8b66f47-2618-447c-b1b2-2e9e2d5cf906" returned: 0 in 0.330s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.633s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1253837216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e39c82-98af-4264-9753-3a3116dc4b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4aad29167d4552b13d37e69bc708ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:56Z,use_quota=True,user_id='2efde6e44baa43cf963c426d24ca92d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Creating volume 18e39c82-98af-4264-9753-3a3116dc4b37 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:29:58 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-18e39c82-98af-4264-9753-3a3116dc4b37 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (161cf90b-3af5-4a52-b286-ff48d1aee07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8b66f47-2618-447c-b1b2-2e9e2d5cf906', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:58 devstack sudo[108397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-18e39c82-98af-4264-9753-3a3116dc4b37 1073741824
Sep 28 18:29:58 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d23a709-3cdd-4e8e-943e-97e92c71bae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:58 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Volume volume-e8b66f47-2618-447c-b1b2-2e9e2d5cf906 (e8b66f47-2618-447c-b1b2-2e9e2d5cf906): created successfully
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d23a709-3cdd-4e8e-943e-97e92c71bae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Flow 'volume_create_manager' (194aac92-8a2e-4b02-b5bc-28425d45d447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:58 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-91dc7106-3eef-48e6-b2f4-efe62175c3a8 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Created volume successfully.
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e0b94045-4976-457d-8785-62a999166938 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "cinder-092f3f6c-4721-45ed-9fba-0f5afe026b57-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:58 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13 1G" returned: 0 in 0.411s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Downloaded image 86b3d5e9-29ab-4230-a8c4-33c49461799f ((None, [{'url': 'file:///opt/stack/data/glance/images/86b3d5e9-29ab-4230-a8c4-33c49461799f', 'metadata': {}}])) to volume aec0a61c-7cd3-4a83-afd8-4b0edb27de13 successfully. {{(pid=87046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Temporary image 86b3d5e9-29ab-4230-a8c4-33c49461799f for user 19a466147cbf437b98f688dfe5fcf30b is deleted. {{(pid=87046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.volume.volume_utils [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Marking volume aec0a61c-7cd3-4a83-afd8-4b0edb27de13 as bootable. {{(pid=87046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e0b94045-4976-457d-8785-62a999166938 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-092f3f6c-4721-45ed-9fba-0f5afe026b57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e0b94045-4976-457d-8785-62a999166938 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "cinder-quobyte-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Copying metadata from image 86b3d5e9-29ab-4230-a8c4-33c49461799f to aec0a61c-7cd3-4a83-afd8-4b0edb27de13. {{(pid=87046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Creating volume glance metadata for volume aec0a61c-7cd3-4a83-afd8-4b0edb27de13 backed by image 86b3d5e9-29ab-4230-a8c4-33c49461799f with: {'image_id': '86b3d5e9-29ab-4230-a8c4-33c49461799f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0c5cbd0af42b76afb7225d05d92e12b0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e0b94045-4976-457d-8785-62a999166938 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-quobyte-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e0b94045-4976-457d-8785-62a999166938 tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "cinder-quobyte-092f3f6c-4721-45ed-9fba-0f5afe026b57" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e0b94045-4976-457d-8785-62a999166938 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-quobyte-092f3f6c-4721-45ed-9fba-0f5afe026b57" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-e0b94045-4976-457d-8785-62a999166938 tempest-CreateVolumesFromSnapshotTest-859314465 None] Deleting offline snapshot 092f3f6c-4721-45ed-9fba-0f5afe026b57 of volume 1b8e6e8a-2a7a-4259-9e2d-38a3605535d4 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-e0b94045-4976-457d-8785-62a999166938 tempest-CreateVolumesFromSnapshotTest-859314465 None] snapshot_file for this snap is: volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.092f3f6c-4721-45ed-9fba-0f5afe026b57 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d083a669-c820-43c3-b80c-9e00c0db6b44]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e0b94045-4976-457d-8785-62a999166938 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.092f3f6c-4721-45ed-9fba-0f5afe026b57 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46863f6e-ed10-42b4-811e-7d7bf34aeb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13', 'volume_size': 1, 'image_id': '86b3d5e9-29ab-4230-a8c4-33c49461799f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86b3d5e9-29ab-4230-a8c4-33c49461799f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0c5cbd0af42b76afb7225d05d92e12b0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f67c2772e7594bb1a8df57c06b02d101', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a83bce2b876d4e017ee4afe82a391f1585c0cd7d836c0d87065452f2336be76271f59411bc4ebac18e1650da53ddbe7cc32b1aa7c45a444063129586e2187b86', 'id': '86b3d5e9-29ab-4230-a8c4-33c49461799f', 'created_at': datetime.datetime(2026, 9, 28, 16, 29, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 29, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86b3d5e9-29ab-4230-a8c4-33c49461799f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a6aa4a67d10>}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f17b04d-5742-4f1c-ba51-1f59a5b534ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:58 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Volume volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13 (aec0a61c-7cd3-4a83-afd8-4b0edb27de13): created successfully
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f17b04d-5742-4f1c-ba51-1f59a5b534ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Flow 'volume_create_manager' (51a720bc-2fde-40df-ab68-94f0bc387674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:58 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-8b62e571-be11-451e-9a86-76c50fc28a40 tempest-VolumeImageDependencyTests-917844736 None] Created volume successfully.
Sep 28 18:29:58 devstack sudo[108406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.092f3f6c-4721-45ed-9fba-0f5afe026b57
Sep 28 18:29:58 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:58 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-18e39c82-98af-4264-9753-3a3116dc4b37 1073741824" returned: 0 in 0.533s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-18e39c82-98af-4264-9753-3a3116dc4b37 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:59 devstack sudo[108409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-18e39c82-98af-4264-9753-3a3116dc4b37
Sep 28 18:29:59 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:59 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e0b94045-4976-457d-8785-62a999166938 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.092f3f6c-4721-45ed-9fba-0f5afe026b57" returned: 0 in 0.425s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-e0b94045-4976-457d-8785-62a999166938 tempest-CreateVolumesFromSnapshotTest-859314465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42d5ccf-55b5-41ed-b2ec-2087af0a4aca]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e0b94045-4976-457d-8785-62a999166938 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:59 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-18e39c82-98af-4264-9753-3a3116dc4b37" returned: 0 in 0.291s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.062s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1694798553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d54add4-d5f9-4954-a24e-63e4cae7baf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4aad29167d4552b13d37e69bc708ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:57Z,use_quota=True,user_id='2efde6e44baa43cf963c426d24ca92d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Creating volume 4d54add4-d5f9-4954-a24e-63e4cae7baf0 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:29:59 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d54add4-d5f9-4954-a24e-63e4cae7baf0 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:59 devstack sudo[108415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4
Sep 28 18:29:59 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f70a8f-c075-4351-9235-a91e92d8093c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18e39c82-98af-4264-9753-3a3116dc4b37', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:59 devstack sudo[108417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d54add4-d5f9-4954-a24e-63e4cae7baf0 1073741824
Sep 28 18:29:59 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d048381-969f-44b2-a6df-6f38d628132c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:29:59 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Volume volume-18e39c82-98af-4264-9753-3a3116dc4b37 (18e39c82-98af-4264-9753-3a3116dc4b37): created successfully
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d048381-969f-44b2-a6df-6f38d628132c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Flow 'volume_create_manager' (27c583b0-8522-42f8-b5eb-646938820c1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:29:59 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-239b9883-491d-42c6-b4b2-a276172143f5 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Created volume successfully.
Sep 28 18:29:59 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e0b94045-4976-457d-8785-62a999166938 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4" returned: 0 in 0.407s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e0b94045-4976-457d-8785-62a999166938 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.092f3f6c-4721-45ed-9fba-0f5afe026b57 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:59 devstack sudo[108426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.092f3f6c-4721-45ed-9fba-0f5afe026b57
Sep 28 18:29:59 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:29:59 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d54add4-d5f9-4954-a24e-63e4cae7baf0 1073741824" returned: 0 in 0.548s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:29:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d54add4-d5f9-4954-a24e-63e4cae7baf0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:29:59 devstack sudo[108430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d54add4-d5f9-4954-a24e-63e4cae7baf0
Sep 28 18:29:59 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-26fa729d-f770-4575-8a37-ad05a0aca8d7 tempest-VolumeImageDependencyTests-917844736 None] Acquiring lock "cinder-aec0a61c-7cd3-4a83-afd8-4b0edb27de13-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:00 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-26fa729d-f770-4575-8a37-ad05a0aca8d7 tempest-VolumeImageDependencyTests-917844736 None] Lock "cinder-aec0a61c-7cd3-4a83-afd8-4b0edb27de13-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e0b94045-4976-457d-8785-62a999166938 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.092f3f6c-4721-45ed-9fba-0f5afe026b57" returned: 0 in 0.487s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e0b94045-4976-457d-8785-62a999166938 tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.092f3f6c-4721-45ed-9fba-0f5afe026b57 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:00 devstack sudo[108435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.092f3f6c-4721-45ed-9fba-0f5afe026b57
Sep 28 18:30:00 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-26fa729d-f770-4575-8a37-ad05a0aca8d7 tempest-VolumeImageDependencyTests-917844736 None] Acquiring lock "cinder-quobyte-aec0a61c-7cd3-4a83-afd8-4b0edb27de13" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-26fa729d-f770-4575-8a37-ad05a0aca8d7 tempest-VolumeImageDependencyTests-917844736 None] Lock "cinder-quobyte-aec0a61c-7cd3-4a83-afd8-4b0edb27de13" acquired by "delete_volume" :: waited 0.039s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:00 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d54add4-d5f9-4954-a24e-63e4cae7baf0" returned: 0 in 0.364s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3ebdc6-a5a5-4905-8ed0-888c412f54ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d54add4-d5f9-4954-a24e-63e4cae7baf0', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b97f2e-eb13-42d0-8110-0e9ec07202b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bd4d86-109b-445b-b2a8-77e51d93ed61]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-26fa729d-f770-4575-8a37-ad05a0aca8d7 tempest-VolumeImageDependencyTests-917844736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:00 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Volume volume-4d54add4-d5f9-4954-a24e-63e4cae7baf0 (4d54add4-d5f9-4954-a24e-63e4cae7baf0): created successfully
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b97f2e-eb13-42d0-8110-0e9ec07202b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Flow 'volume_create_manager' (630e13b3-b68f-4980-ba48-004d18a34d8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:00 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-6b58b25c-54f5-4f67-8d47-fa90f38f7014 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Created volume successfully.
Sep 28 18:30:00 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e0b94045-4976-457d-8785-62a999166938 tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4.092f3f6c-4721-45ed-9fba-0f5afe026b57" returned: 0 in 0.378s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:00 devstack sudo[108438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13
Sep 28 18:30:00 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-bc467752-abd2-4871-a8a9-5bbc08137c8f tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "cinder-4d54add4-d5f9-4954-a24e-63e4cae7baf0-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e0b94045-4976-457d-8785-62a999166938 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-quobyte-092f3f6c-4721-45ed-9fba-0f5afe026b57" released by "_delete_snapshot" :: held 1.863s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e0b94045-4976-457d-8785-62a999166938 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-quobyte-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4" released by "delete_snapshot" :: held 1.910s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-bc467752-abd2-4871-a8a9-5bbc08137c8f tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-4d54add4-d5f9-4954-a24e-63e4cae7baf0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-bc467752-abd2-4871-a8a9-5bbc08137c8f tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "cinder-quobyte-4d54add4-d5f9-4954-a24e-63e4cae7baf0" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-bc467752-abd2-4871-a8a9-5bbc08137c8f tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-quobyte-4d54add4-d5f9-4954-a24e-63e4cae7baf0" acquired by "delete_volume" :: waited 0.021s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-e0b94045-4976-457d-8785-62a999166938 tempest-CreateVolumesFromSnapshotTest-859314465 None] Created reservations ['25cc4292-e547-436e-8e21-48558d382a32', '83f1d09f-ca2e-46ec-9f37-c7d2a8b01c78', '77af3b65-ccf4-4594-a845-7368ea76dec1', '4c35e83b-e8fc-4bbd-8d4b-bada7f7ac795'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f955518-9061-43f7-babd-38604c62a7c1]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bc467752-abd2-4871-a8a9-5bbc08137c8f tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d54add4-d5f9-4954-a24e-63e4cae7baf0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:00 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-e0b94045-4976-457d-8785-62a999166938 tempest-CreateVolumesFromSnapshotTest-859314465 None] Delete snapshot completed successfully.
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e0b94045-4976-457d-8785-62a999166938 tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-092f3f6c-4721-45ed-9fba-0f5afe026b57-delete_snapshot" released by "delete_snapshot" :: held 2.168s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:00 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-26fa729d-f770-4575-8a37-ad05a0aca8d7 tempest-VolumeImageDependencyTests-917844736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13" returned: 0 in 0.544s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-26fa729d-f770-4575-8a37-ad05a0aca8d7 tempest-VolumeImageDependencyTests-917844736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:00 devstack sudo[108441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d54add4-d5f9-4954-a24e-63e4cae7baf0
Sep 28 18:30:00 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:00 devstack sudo[108446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13
Sep 28 18:30:00 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:01 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-26fa729d-f770-4575-8a37-ad05a0aca8d7 tempest-VolumeImageDependencyTests-917844736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-aec0a61c-7cd3-4a83-afd8-4b0edb27de13" returned: 0 in 0.273s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-26fa729d-f770-4575-8a37-ad05a0aca8d7 tempest-VolumeImageDependencyTests-917844736 None] Lock "cinder-quobyte-aec0a61c-7cd3-4a83-afd8-4b0edb27de13" released by "delete_volume" :: held 0.912s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:01 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bc467752-abd2-4871-a8a9-5bbc08137c8f tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d54add4-d5f9-4954-a24e-63e4cae7baf0" returned: 0 in 0.461s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bc467752-abd2-4871-a8a9-5bbc08137c8f tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d54add4-d5f9-4954-a24e-63e4cae7baf0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:01 devstack sudo[108453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d54add4-d5f9-4954-a24e-63e4cae7baf0
Sep 28 18:30:01 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-26fa729d-f770-4575-8a37-ad05a0aca8d7 tempest-VolumeImageDependencyTests-917844736 None] Created reservations ['1223ff47-c2e3-416b-a6d4-882aadee369f', '91ed4d6e-0dba-4e50-9f92-70ef40016084', '15b554d3-ed7a-4025-b11f-df19a9a9e64c', '1e78aa79-db0b-4277-8a03-ab95f7a6c0da'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-26fa729d-f770-4575-8a37-ad05a0aca8d7 tempest-VolumeImageDependencyTests-917844736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-26fa729d-f770-4575-8a37-ad05a0aca8d7 tempest-VolumeImageDependencyTests-917844736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-26fa729d-f770-4575-8a37-ad05a0aca8d7 tempest-VolumeImageDependencyTests-917844736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-26fa729d-f770-4575-8a37-ad05a0aca8d7 tempest-VolumeImageDependencyTests-917844736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-26fa729d-f770-4575-8a37-ad05a0aca8d7 tempest-VolumeImageDependencyTests-917844736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-26fa729d-f770-4575-8a37-ad05a0aca8d7 tempest-VolumeImageDependencyTests-917844736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:01 devstack sudo[108455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:30:01 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:01 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bc467752-abd2-4871-a8a9-5bbc08137c8f tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d54add4-d5f9-4954-a24e-63e4cae7baf0" returned: 0 in 0.320s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-bc467752-abd2-4871-a8a9-5bbc08137c8f tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-quobyte-4d54add4-d5f9-4954-a24e-63e4cae7baf0" released by "delete_volume" :: held 0.842s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-bc467752-abd2-4871-a8a9-5bbc08137c8f tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Created reservations ['14367c73-dbcd-4063-86e3-dfe1e3c2a933', 'ae7c4a3f-fd81-4c11-9613-1d54481e284b', 'ae673dff-0c0f-4924-821e-8701c7ba2e45', '2ca65c80-eb00-4907-bfed-71579934e84d'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:30:01 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-26fa729d-f770-4575-8a37-ad05a0aca8d7 tempest-VolumeImageDependencyTests-917844736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.301s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-26fa729d-f770-4575-8a37-ad05a0aca8d7 tempest-VolumeImageDependencyTests-917844736 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:30:01 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-26fa729d-f770-4575-8a37-ad05a0aca8d7 tempest-VolumeImageDependencyTests-917844736 None] Deleted volume successfully.
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bc467752-abd2-4871-a8a9-5bbc08137c8f tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bc467752-abd2-4871-a8a9-5bbc08137c8f tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-bc467752-abd2-4871-a8a9-5bbc08137c8f tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-bc467752-abd2-4871-a8a9-5bbc08137c8f tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bc467752-abd2-4871-a8a9-5bbc08137c8f tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bc467752-abd2-4871-a8a9-5bbc08137c8f tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-26fa729d-f770-4575-8a37-ad05a0aca8d7 tempest-VolumeImageDependencyTests-917844736 None] Lock "cinder-aec0a61c-7cd3-4a83-afd8-4b0edb27de13-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-abdc54d2-3f19-4a14-9943-a4793ca5ac4c tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "cinder-18e39c82-98af-4264-9753-3a3116dc4b37-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:01 devstack sudo[108459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:30:01 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-abdc54d2-3f19-4a14-9943-a4793ca5ac4c tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-18e39c82-98af-4264-9753-3a3116dc4b37-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-abdc54d2-3f19-4a14-9943-a4793ca5ac4c tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "cinder-quobyte-18e39c82-98af-4264-9753-3a3116dc4b37" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-abdc54d2-3f19-4a14-9943-a4793ca5ac4c tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-quobyte-18e39c82-98af-4264-9753-3a3116dc4b37" acquired by "delete_volume" :: waited 0.024s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[998ff99f-2539-4e7d-b277-d7081d71cec0]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-abdc54d2-3f19-4a14-9943-a4793ca5ac4c tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-18e39c82-98af-4264-9753-3a3116dc4b37 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a273f1a4-a3af-46c4-954e-bf934543624c tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "cinder-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a273f1a4-a3af-46c4-954e-bf934543624c tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:02 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a273f1a4-a3af-46c4-954e-bf934543624c tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "cinder-quobyte-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:02 devstack sudo[108467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-18e39c82-98af-4264-9753-3a3116dc4b37
Sep 28 18:30:02 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:02 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a273f1a4-a3af-46c4-954e-bf934543624c tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-quobyte-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4" acquired by "delete_volume" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:02 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bc467752-abd2-4871-a8a9-5bbc08137c8f tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.375s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:02 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-bc467752-abd2-4871-a8a9-5bbc08137c8f tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:30:02 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1abe28-8b3b-48de-b850-c4b94212d2fd]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a273f1a4-a3af-46c4-954e-bf934543624c tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:02 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-bc467752-abd2-4871-a8a9-5bbc08137c8f tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Deleted volume successfully.
Sep 28 18:30:02 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-bc467752-abd2-4871-a8a9-5bbc08137c8f tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-4d54add4-d5f9-4954-a24e-63e4cae7baf0-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:02 devstack sudo[108470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4
Sep 28 18:30:02 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:02 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-abdc54d2-3f19-4a14-9943-a4793ca5ac4c tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-18e39c82-98af-4264-9753-3a3116dc4b37" returned: 0 in 0.460s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-abdc54d2-3f19-4a14-9943-a4793ca5ac4c tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-18e39c82-98af-4264-9753-3a3116dc4b37 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:02 devstack sudo[108475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-18e39c82-98af-4264-9753-3a3116dc4b37
Sep 28 18:30:02 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:02 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a273f1a4-a3af-46c4-954e-bf934543624c tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4" returned: 0 in 0.513s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a273f1a4-a3af-46c4-954e-bf934543624c tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:02 devstack sudo[108480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4
Sep 28 18:30:02 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:02 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-abdc54d2-3f19-4a14-9943-a4793ca5ac4c tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-18e39c82-98af-4264-9753-3a3116dc4b37" returned: 0 in 0.358s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:02 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-abdc54d2-3f19-4a14-9943-a4793ca5ac4c tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-quobyte-18e39c82-98af-4264-9753-3a3116dc4b37" released by "delete_volume" :: held 0.891s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:02 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-abdc54d2-3f19-4a14-9943-a4793ca5ac4c tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Created reservations ['b2f33e63-4cd3-4d16-9a5f-453953136dd8', 'dbc08128-f10f-4cec-8f87-087c34da2608', 'b8ea1add-9fea-4af9-a406-20e8669c6e5e', '997e5b5f-440d-4243-ad40-3eae43729ddc'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:30:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-abdc54d2-3f19-4a14-9943-a4793ca5ac4c tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-abdc54d2-3f19-4a14-9943-a4793ca5ac4c tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:02 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-abdc54d2-3f19-4a14-9943-a4793ca5ac4c tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:02 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-abdc54d2-3f19-4a14-9943-a4793ca5ac4c tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-abdc54d2-3f19-4a14-9943-a4793ca5ac4c tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-abdc54d2-3f19-4a14-9943-a4793ca5ac4c tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:02 devstack sudo[108484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:30:02 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:02 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a273f1a4-a3af-46c4-954e-bf934543624c tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4" returned: 0 in 0.385s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d47a8daa-d73b-47c7-b037-ea9b5237e865 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "cinder-e8b66f47-2618-447c-b1b2-2e9e2d5cf906-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a273f1a4-a3af-46c4-954e-bf934543624c tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-quobyte-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4" released by "delete_volume" :: held 1.012s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d47a8daa-d73b-47c7-b037-ea9b5237e865 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-e8b66f47-2618-447c-b1b2-2e9e2d5cf906-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d47a8daa-d73b-47c7-b037-ea9b5237e865 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "cinder-quobyte-e8b66f47-2618-447c-b1b2-2e9e2d5cf906" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-a273f1a4-a3af-46c4-954e-bf934543624c tempest-CreateVolumesFromSnapshotTest-859314465 None] Created reservations ['045a6114-3a13-4be8-8d37-2f92d5f7d5e9', '18f85bba-e514-4d8f-bc4b-a19f71a0cb0c', '045a892d-fe50-4ea7-9be7-a1756946a43b', '0223a737-a5f3-4271-b804-cadf5fd5ab6b'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d47a8daa-d73b-47c7-b037-ea9b5237e865 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-quobyte-e8b66f47-2618-447c-b1b2-2e9e2d5cf906" acquired by "delete_volume" :: waited 0.036s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7b4f2c-ad41-4e94-b7e6-5651f276668a]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d47a8daa-d73b-47c7-b037-ea9b5237e865 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e8b66f47-2618-447c-b1b2-2e9e2d5cf906 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a273f1a4-a3af-46c4-954e-bf934543624c tempest-CreateVolumesFromSnapshotTest-859314465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a273f1a4-a3af-46c4-954e-bf934543624c tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a273f1a4-a3af-46c4-954e-bf934543624c tempest-CreateVolumesFromSnapshotTest-859314465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a273f1a4-a3af-46c4-954e-bf934543624c tempest-CreateVolumesFromSnapshotTest-859314465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a273f1a4-a3af-46c4-954e-bf934543624c tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a273f1a4-a3af-46c4-954e-bf934543624c tempest-CreateVolumesFromSnapshotTest-859314465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:03 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:03 devstack sudo[108489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:30:03 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-abdc54d2-3f19-4a14-9943-a4793ca5ac4c tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.448s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-abdc54d2-3f19-4a14-9943-a4793ca5ac4c tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:30:03 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-abdc54d2-3f19-4a14-9943-a4793ca5ac4c tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Deleted volume successfully.
Sep 28 18:30:03 devstack sudo[108486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e8b66f47-2618-447c-b1b2-2e9e2d5cf906
Sep 28 18:30:03 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-abdc54d2-3f19-4a14-9943-a4793ca5ac4c tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-18e39c82-98af-4264-9753-3a3116dc4b37-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:03 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a273f1a4-a3af-46c4-954e-bf934543624c tempest-CreateVolumesFromSnapshotTest-859314465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.304s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-a273f1a4-a3af-46c4-954e-bf934543624c tempest-CreateVolumesFromSnapshotTest-859314465 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:30:03 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-a273f1a4-a3af-46c4-954e-bf934543624c tempest-CreateVolumesFromSnapshotTest-859314465 None] Deleted volume successfully.
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-a273f1a4-a3af-46c4-954e-bf934543624c tempest-CreateVolumesFromSnapshotTest-859314465 None] Lock "cinder-1b8e6e8a-2a7a-4259-9e2d-38a3605535d4-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:03 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d47a8daa-d73b-47c7-b037-ea9b5237e865 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e8b66f47-2618-447c-b1b2-2e9e2d5cf906" returned: 0 in 0.455s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d47a8daa-d73b-47c7-b037-ea9b5237e865 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e8b66f47-2618-447c-b1b2-2e9e2d5cf906 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:03 devstack sudo[108496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e8b66f47-2618-447c-b1b2-2e9e2d5cf906
Sep 28 18:30:03 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:03 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d47a8daa-d73b-47c7-b037-ea9b5237e865 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e8b66f47-2618-447c-b1b2-2e9e2d5cf906" returned: 0 in 0.288s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d47a8daa-d73b-47c7-b037-ea9b5237e865 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-quobyte-e8b66f47-2618-447c-b1b2-2e9e2d5cf906" released by "delete_volume" :: held 0.806s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:04 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-d47a8daa-d73b-47c7-b037-ea9b5237e865 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Created reservations ['f998fe0c-7dd5-4993-8f78-f514bbe3269a', '667a0a96-14e3-45cf-a0a6-ae84d843aee6', '0f9b3145-ecf9-469f-988f-f5b86af6c1ba', '41753fe8-9f52-461d-8c78-67bb147e2a3f'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:30:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d47a8daa-d73b-47c7-b037-ea9b5237e865 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d47a8daa-d73b-47c7-b037-ea9b5237e865 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:04 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d47a8daa-d73b-47c7-b037-ea9b5237e865 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:04 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d47a8daa-d73b-47c7-b037-ea9b5237e865 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d47a8daa-d73b-47c7-b037-ea9b5237e865 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d47a8daa-d73b-47c7-b037-ea9b5237e865 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:04 devstack sudo[108499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:30:04 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5d68480b-ac63-4a9f-96b3-91656e3eb7af tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "cinder-e2fc7af6-f55c-417c-ac41-14f6b122fd10-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5d68480b-ac63-4a9f-96b3-91656e3eb7af tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-e2fc7af6-f55c-417c-ac41-14f6b122fd10-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5d68480b-ac63-4a9f-96b3-91656e3eb7af tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "cinder-quobyte-e2fc7af6-f55c-417c-ac41-14f6b122fd10" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5d68480b-ac63-4a9f-96b3-91656e3eb7af tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-quobyte-e2fc7af6-f55c-417c-ac41-14f6b122fd10" acquired by "delete_volume" :: waited 0.016s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:04 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4299f06b-724d-47b0-b688-178fddf9a211]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5d68480b-ac63-4a9f-96b3-91656e3eb7af tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e2fc7af6-f55c-417c-ac41-14f6b122fd10 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:04 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d47a8daa-d73b-47c7-b037-ea9b5237e865 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.452s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:04 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d47a8daa-d73b-47c7-b037-ea9b5237e865 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:30:04 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d47a8daa-d73b-47c7-b037-ea9b5237e865 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Deleted volume successfully.
Sep 28 18:30:04 devstack sudo[108501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e2fc7af6-f55c-417c-ac41-14f6b122fd10
Sep 28 18:30:04 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d47a8daa-d73b-47c7-b037-ea9b5237e865 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-e8b66f47-2618-447c-b1b2-2e9e2d5cf906-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:05 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5d68480b-ac63-4a9f-96b3-91656e3eb7af tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e2fc7af6-f55c-417c-ac41-14f6b122fd10" returned: 0 in 0.611s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5d68480b-ac63-4a9f-96b3-91656e3eb7af tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e2fc7af6-f55c-417c-ac41-14f6b122fd10 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:05 devstack sudo[108507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e2fc7af6-f55c-417c-ac41-14f6b122fd10
Sep 28 18:30:05 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:05 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5d68480b-ac63-4a9f-96b3-91656e3eb7af tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-e2fc7af6-f55c-417c-ac41-14f6b122fd10" returned: 0 in 0.350s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5d68480b-ac63-4a9f-96b3-91656e3eb7af tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-quobyte-e2fc7af6-f55c-417c-ac41-14f6b122fd10" released by "delete_volume" :: held 1.020s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:05 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-5d68480b-ac63-4a9f-96b3-91656e3eb7af tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Created reservations ['b36ff5c6-0567-44a2-b32a-6de955a1bb68', '6427bed5-ffbe-4f42-b58a-d44bfde81ada', 'b9302913-4b81-4e71-9fea-63bec73208ea', 'f91f6d16-26b8-40be-943c-1d1fda03c234'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:30:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5d68480b-ac63-4a9f-96b3-91656e3eb7af tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5d68480b-ac63-4a9f-96b3-91656e3eb7af tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5d68480b-ac63-4a9f-96b3-91656e3eb7af tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5d68480b-ac63-4a9f-96b3-91656e3eb7af tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5d68480b-ac63-4a9f-96b3-91656e3eb7af tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5d68480b-ac63-4a9f-96b3-91656e3eb7af tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:05 devstack sudo[108510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:30:05 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:05 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5d68480b-ac63-4a9f-96b3-91656e3eb7af tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.335s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:05 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-5d68480b-ac63-4a9f-96b3-91656e3eb7af tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:30:05 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-5d68480b-ac63-4a9f-96b3-91656e3eb7af tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Deleted volume successfully.
Sep 28 18:30:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5d68480b-ac63-4a9f-96b3-91656e3eb7af tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-e2fc7af6-f55c-417c-ac41-14f6b122fd10-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:06 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b73b0ba3-b972-464b-b9a2-93d56e259915 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "cinder-1f964ea2-46e2-41e4-84bf-40b76f5dee26-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:06 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b73b0ba3-b972-464b-b9a2-93d56e259915 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-1f964ea2-46e2-41e4-84bf-40b76f5dee26-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:06 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b73b0ba3-b972-464b-b9a2-93d56e259915 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "cinder-quobyte-1f964ea2-46e2-41e4-84bf-40b76f5dee26" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:06 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b73b0ba3-b972-464b-b9a2-93d56e259915 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-quobyte-1f964ea2-46e2-41e4-84bf-40b76f5dee26" acquired by "delete_volume" :: waited 0.024s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:06 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9238da5f-1576-4f99-9841-294b86f3148e]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b73b0ba3-b972-464b-b9a2-93d56e259915 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f964ea2-46e2-41e4-84bf-40b76f5dee26 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:06 devstack sudo[108513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f964ea2-46e2-41e4-84bf-40b76f5dee26
Sep 28 18:30:06 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:07 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b73b0ba3-b972-464b-b9a2-93d56e259915 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f964ea2-46e2-41e4-84bf-40b76f5dee26" returned: 0 in 0.568s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b73b0ba3-b972-464b-b9a2-93d56e259915 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f964ea2-46e2-41e4-84bf-40b76f5dee26 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:07 devstack sudo[108518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f964ea2-46e2-41e4-84bf-40b76f5dee26
Sep 28 18:30:07 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:07 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b73b0ba3-b972-464b-b9a2-93d56e259915 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-1f964ea2-46e2-41e4-84bf-40b76f5dee26" returned: 0 in 0.364s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:07 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b73b0ba3-b972-464b-b9a2-93d56e259915 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-quobyte-1f964ea2-46e2-41e4-84bf-40b76f5dee26" released by "delete_volume" :: held 1.009s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:07 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-b73b0ba3-b972-464b-b9a2-93d56e259915 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Created reservations ['69543310-9a5b-4cd5-845c-8c9746611f39', 'bd3c83dc-9a3b-42e7-8d0d-f1b3d2542263', 'c81f7aeb-1698-452d-919e-842c0e6b647c', '71979a87-411a-404a-a7bd-375e0480a081'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:30:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b73b0ba3-b972-464b-b9a2-93d56e259915 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b73b0ba3-b972-464b-b9a2-93d56e259915 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:07 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b73b0ba3-b972-464b-b9a2-93d56e259915 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:07 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b73b0ba3-b972-464b-b9a2-93d56e259915 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b73b0ba3-b972-464b-b9a2-93d56e259915 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b73b0ba3-b972-464b-b9a2-93d56e259915 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:07 devstack sudo[108521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:30:07 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:08 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b73b0ba3-b972-464b-b9a2-93d56e259915 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.320s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:08 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-b73b0ba3-b972-464b-b9a2-93d56e259915 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:30:08 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-b73b0ba3-b972-464b-b9a2-93d56e259915 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Deleted volume successfully.
Sep 28 18:30:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b73b0ba3-b972-464b-b9a2-93d56e259915 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-1f964ea2-46e2-41e4-84bf-40b76f5dee26-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8960e79b-b64e-4544-a94e-0fd056bfa184 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "cinder-cc23dc4b-a4a5-40e3-af81-0e16a8088bec-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:08 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8960e79b-b64e-4544-a94e-0fd056bfa184 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-cc23dc4b-a4a5-40e3-af81-0e16a8088bec-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8960e79b-b64e-4544-a94e-0fd056bfa184 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "cinder-quobyte-cc23dc4b-a4a5-40e3-af81-0e16a8088bec" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8960e79b-b64e-4544-a94e-0fd056bfa184 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-quobyte-cc23dc4b-a4a5-40e3-af81-0e16a8088bec" acquired by "delete_volume" :: waited 0.023s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:09 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecd3153-cc13-44ef-a59d-0cb0b2a69728]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8960e79b-b64e-4544-a94e-0fd056bfa184 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc23dc4b-a4a5-40e3-af81-0e16a8088bec {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:09 devstack sudo[108524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc23dc4b-a4a5-40e3-af81-0e16a8088bec
Sep 28 18:30:09 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:09 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8960e79b-b64e-4544-a94e-0fd056bfa184 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc23dc4b-a4a5-40e3-af81-0e16a8088bec" returned: 0 in 0.503s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8960e79b-b64e-4544-a94e-0fd056bfa184 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc23dc4b-a4a5-40e3-af81-0e16a8088bec {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:09 devstack sudo[108530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc23dc4b-a4a5-40e3-af81-0e16a8088bec
Sep 28 18:30:09 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:09 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8960e79b-b64e-4544-a94e-0fd056bfa184 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-cc23dc4b-a4a5-40e3-af81-0e16a8088bec" returned: 0 in 0.361s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:10 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8960e79b-b64e-4544-a94e-0fd056bfa184 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-quobyte-cc23dc4b-a4a5-40e3-af81-0e16a8088bec" released by "delete_volume" :: held 0.968s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:10 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-8960e79b-b64e-4544-a94e-0fd056bfa184 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Created reservations ['6ffd5936-4f10-4081-907f-16e8b0d052fb', '1dc58907-b8f7-4207-b173-cd762cbdbc64', '31fe1ffb-79db-44f9-a970-49ac00a19c44', '583fc610-5bdc-4ea3-9fdd-fca1cafb29d9'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:30:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8960e79b-b64e-4544-a94e-0fd056bfa184 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8960e79b-b64e-4544-a94e-0fd056bfa184 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:10 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8960e79b-b64e-4544-a94e-0fd056bfa184 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:10 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8960e79b-b64e-4544-a94e-0fd056bfa184 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8960e79b-b64e-4544-a94e-0fd056bfa184 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8960e79b-b64e-4544-a94e-0fd056bfa184 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:10 devstack sudo[108533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:30:10 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:10 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8960e79b-b64e-4544-a94e-0fd056bfa184 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.364s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:10 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-8960e79b-b64e-4544-a94e-0fd056bfa184 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:30:10 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-8960e79b-b64e-4544-a94e-0fd056bfa184 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Deleted volume successfully.
Sep 28 18:30:10 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8960e79b-b64e-4544-a94e-0fd056bfa184 tempest-CreateVolumesFromSourceVolumeTest-424128471 None] Lock "cinder-cc23dc4b-a4a5-40e3-af81-0e16a8088bec-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Flow 'volume_create_manager' (baa28f54-aa5b-493a-8267-de8e4a669f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e5e400-2a7c-42b9-80cc-08bd699bad55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e5e400-2a7c-42b9-80cc-08bd699bad55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-296331932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c9afd1a-3817-4c3d-8322-d81170df2555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347f48b5e6b04da585f42681b69bbb2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:15Z,use_quota=True,user_id='32f6bf1bdb3c4fc4a50f20b815066d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74cd828-525f-47dc-b799-58538f905ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74cd828-525f-47dc-b799-58538f905ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd37c65-a320-404d-a661-62e25a74d3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd37c65-a320-404d-a661-62e25a74d3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c9afd1a-3817-4c3d-8322-d81170df2555', 'volume_name': 'volume-8c9afd1a-3817-4c3d-8322-d81170df2555', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3d543b-a92c-4d32-a17a-b4a876b3a3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3d543b-a92c-4d32-a17a-b4a876b3a3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fedbffde-7126-4fd6-b635-a15d81ab5847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:15 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Volume 8c9afd1a-3817-4c3d-8322-d81170df2555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c9afd1a-3817-4c3d-8322-d81170df2555', 'volume_size': 1}
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-296331932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c9afd1a-3817-4c3d-8322-d81170df2555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347f48b5e6b04da585f42681b69bbb2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:15Z,use_quota=True,user_id='32f6bf1bdb3c4fc4a50f20b815066d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Creating volume 8c9afd1a-3817-4c3d-8322-d81170df2555 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:30:15 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:15 devstack sudo[108539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555 1073741824
Sep 28 18:30:15 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:15 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555 1073741824" returned: 0 in 0.563s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:15 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:16 devstack sudo[108544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555
Sep 28 18:30:16 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Flow 'volume_create_manager' (eb9d5660-b8ed-45fa-a4c7-10626c5a3c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (197bc00d-5bc0-4a4f-98a8-1e4047b7500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (197bc00d-5bc0-4a4f-98a8-1e4047b7500f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-411617849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27518baa-bf8b-41d7-b58f-b4a30c204d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7141bfada145467eb777f5e9601f614e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:16Z,use_quota=True,user_id='19ef54da5952457abebbe56a45760423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9a34c6-0aa0-40c3-afe4-26921216d24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9a34c6-0aa0-40c3-afe4-26921216d24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761a6bc3-cc36-406e-a5f9-59bdb1abdf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761a6bc3-cc36-406e-a5f9-59bdb1abdf22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27518baa-bf8b-41d7-b58f-b4a30c204d98', 'volume_name': 'volume-27518baa-bf8b-41d7-b58f-b4a30c204d98', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a2a370-98dc-4e98-b8d4-0cc6392e9b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a2a370-98dc-4e98-b8d4-0cc6392e9b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035e65f8-5903-479d-bbe0-03f2caef4146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:16 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Volume 27518baa-bf8b-41d7-b58f-b4a30c204d98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27518baa-bf8b-41d7-b58f-b4a30c204d98', 'volume_size': 1}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:16 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555" returned: 0 in 0.343s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.056s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-411617849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27518baa-bf8b-41d7-b58f-b4a30c204d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7141bfada145467eb777f5e9601f614e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:16Z,use_quota=True,user_id='19ef54da5952457abebbe56a45760423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Creating volume 27518baa-bf8b-41d7-b58f-b4a30c204d98 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:30:16 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fedbffde-7126-4fd6-b635-a15d81ab5847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c9afd1a-3817-4c3d-8322-d81170df2555', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50ac093-99e1-4f90-8a04-8af064b3244f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:16 devstack sudo[108547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98 1073741824
Sep 28 18:30:16 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:16 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Volume volume-8c9afd1a-3817-4c3d-8322-d81170df2555 (8c9afd1a-3817-4c3d-8322-d81170df2555): created successfully
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50ac093-99e1-4f90-8a04-8af064b3244f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Flow 'volume_create_manager' (baa28f54-aa5b-493a-8267-de8e4a669f07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:16 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-3ab1423a-d908-4caa-8c03-d7ab5c5e01cd tempest-VolumeDependencyTests-1102956373 None] Created volume successfully.
Sep 28 18:30:16 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98 1073741824" returned: 0 in 0.592s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:16 devstack sudo[108553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98
Sep 28 18:30:16 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Flow 'volume_create_manager' (4d7b8296-0ca0-4e7c-88d8-629d877d9d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12420e5-97d2-427a-9cfd-c0cff7deb8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12420e5-97d2-427a-9cfd-c0cff7deb8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1792251426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e01c45-9bb5-4f85-b789-92344cc5c67c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d58b19efcfb49c89a9a113492021676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:17Z,use_quota=True,user_id='aecee5298d5b460fa8aed472bbccb9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055856c5-d236-4d51-98e0-77a45bf88c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055856c5-d236-4d51-98e0-77a45bf88c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a84555-1287-4a29-acf6-7c24271dd451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a84555-1287-4a29-acf6-7c24271dd451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39e01c45-9bb5-4f85-b789-92344cc5c67c', 'volume_name': 'volume-39e01c45-9bb5-4f85-b789-92344cc5c67c', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717c43f4-0136-4e2c-b830-93cf81770e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717c43f4-0136-4e2c-b830-93cf81770e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (722452bd-5f3f-4649-9412-6d42713ad3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:17 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Volume 39e01c45-9bb5-4f85-b789-92344cc5c67c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39e01c45-9bb5-4f85-b789-92344cc5c67c', 'volume_size': 1}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:17 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98" returned: 0 in 0.306s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.094s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1792251426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e01c45-9bb5-4f85-b789-92344cc5c67c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d58b19efcfb49c89a9a113492021676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:17Z,use_quota=True,user_id='aecee5298d5b460fa8aed472bbccb9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Creating volume 39e01c45-9bb5-4f85-b789-92344cc5c67c {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:30:17 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-39e01c45-9bb5-4f85-b789-92344cc5c67c 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035e65f8-5903-479d-bbe0-03f2caef4146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27518baa-bf8b-41d7-b58f-b4a30c204d98', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a5e45a-4eee-4b07-9c1a-aa1a7eb1e7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:17 devstack sudo[108556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-39e01c45-9bb5-4f85-b789-92344cc5c67c 1073741824
Sep 28 18:30:17 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:17 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Volume volume-27518baa-bf8b-41d7-b58f-b4a30c204d98 (27518baa-bf8b-41d7-b58f-b4a30c204d98): created successfully
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a5e45a-4eee-4b07-9c1a-aa1a7eb1e7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Flow 'volume_create_manager' (eb9d5660-b8ed-45fa-a4c7-10626c5a3c49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:17 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-31702f17-80ae-43a3-9c84-dbac159a1b50 tempest-ProjectMemberTests-2016434849 None] Created volume successfully.
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9cec820f-b4b1-4752-8da8-c6e8e06b73da tempest-VolumeDependencyTests-1102956373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:17 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-39e01c45-9bb5-4f85-b789-92344cc5c67c 1073741824" returned: 0 in 0.533s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-39e01c45-9bb5-4f85-b789-92344cc5c67c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:17 devstack sudo[108562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-39e01c45-9bb5-4f85-b789-92344cc5c67c
Sep 28 18:30:17 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:18 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-39e01c45-9bb5-4f85-b789-92344cc5c67c" returned: 0 in 0.312s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:18 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:30:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9cec820f-b4b1-4752-8da8-c6e8e06b73da tempest-VolumeDependencyTests-1102956373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.684s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (722452bd-5f3f-4649-9412-6d42713ad3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39e01c45-9bb5-4f85-b789-92344cc5c67c', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc602e77-971b-4989-a9a9-321b1ca91e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:18 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-9cec820f-b4b1-4752-8da8-c6e8e06b73da tempest-VolumeDependencyTests-1102956373 None] Creating offline snapshot d467a1d9-9cca-4430-8a66-6c00f21cdaba of volume 8c9afd1a-3817-4c3d-8322-d81170df2555 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:30:18 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Volume volume-39e01c45-9bb5-4f85-b789-92344cc5c67c (39e01c45-9bb5-4f85-b789-92344cc5c67c): created successfully
Sep 28 18:30:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc602e77-971b-4989-a9a9-321b1ca91e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:18 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Flow 'volume_create_manager' (4d7b8296-0ca0-4e7c-88d8-629d877d9d4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:18 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc693204-4d6f-466e-b5d7-6f044d24452a]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9cec820f-b4b1-4752-8da8-c6e8e06b73da tempest-VolumeDependencyTests-1102956373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:18 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-f0e94b43-8b11-4ca3-a6be-f89764006708 tempest-ProjectReaderTests-527406552 None] Created volume successfully.
Sep 28 18:30:18 devstack sudo[108565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555
Sep 28 18:30:18 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-601033c4-9bd9-4e33-83db-65b29466c7cc tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:18 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9cec820f-b4b1-4752-8da8-c6e8e06b73da tempest-VolumeDependencyTests-1102956373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555" returned: 0 in 0.481s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9cec820f-b4b1-4752-8da8-c6e8e06b73da tempest-VolumeDependencyTests-1102956373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:18 devstack sudo[108570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba 1G
Sep 28 18:30:18 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:19 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9cec820f-b4b1-4752-8da8-c6e8e06b73da tempest-VolumeDependencyTests-1102956373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba 1G" returned: 0 in 0.558s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9cec820f-b4b1-4752-8da8-c6e8e06b73da tempest-VolumeDependencyTests-1102956373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c9afd1a-3817-4c3d-8322-d81170df2555 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:19 devstack sudo[108578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c9afd1a-3817-4c3d-8322-d81170df2555 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba
Sep 28 18:30:19 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:19 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8b4179ac-11ae-45ce-841b-e49dc4f39d05 tempest-ProjectReaderTests-527406552 None] Acquiring lock "cinder-39e01c45-9bb5-4f85-b789-92344cc5c67c-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:19 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8b4179ac-11ae-45ce-841b-e49dc4f39d05 tempest-ProjectReaderTests-527406552 None] Lock "cinder-39e01c45-9bb5-4f85-b789-92344cc5c67c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:19 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9cec820f-b4b1-4752-8da8-c6e8e06b73da tempest-VolumeDependencyTests-1102956373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c9afd1a-3817-4c3d-8322-d81170df2555 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba" returned: 0 in 0.372s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:19 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-9cec820f-b4b1-4752-8da8-c6e8e06b73da tempest-VolumeDependencyTests-1102956373 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba is being set with open permissions: ugo+rw
Sep 28 18:30:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9cec820f-b4b1-4752-8da8-c6e8e06b73da tempest-VolumeDependencyTests-1102956373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:19 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8b4179ac-11ae-45ce-841b-e49dc4f39d05 tempest-ProjectReaderTests-527406552 None] Acquiring lock "cinder-quobyte-39e01c45-9bb5-4f85-b789-92344cc5c67c" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:19 devstack sudo[108583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba
Sep 28 18:30:19 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:19 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8b4179ac-11ae-45ce-841b-e49dc4f39d05 tempest-ProjectReaderTests-527406552 None] Lock "cinder-quobyte-39e01c45-9bb5-4f85-b789-92344cc5c67c" acquired by "delete_volume" :: waited 0.016s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:19 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[941986a0-ac81-4129-a9a4-85159321aa45]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b4179ac-11ae-45ce-841b-e49dc4f39d05 tempest-ProjectReaderTests-527406552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-39e01c45-9bb5-4f85-b789-92344cc5c67c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:19 devstack sudo[108585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-39e01c45-9bb5-4f85-b789-92344cc5c67c
Sep 28 18:30:19 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:19 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9cec820f-b4b1-4752-8da8-c6e8e06b73da tempest-VolumeDependencyTests-1102956373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba" returned: 0 in 0.271s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9cec820f-b4b1-4752-8da8-c6e8e06b73da tempest-VolumeDependencyTests-1102956373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:19 devstack sudo[108588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.info
Sep 28 18:30:20 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:20 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b4179ac-11ae-45ce-841b-e49dc4f39d05 tempest-ProjectReaderTests-527406552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-39e01c45-9bb5-4f85-b789-92344cc5c67c" returned: 0 in 0.439s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b4179ac-11ae-45ce-841b-e49dc4f39d05 tempest-ProjectReaderTests-527406552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-39e01c45-9bb5-4f85-b789-92344cc5c67c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:20 devstack sudo[108593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-39e01c45-9bb5-4f85-b789-92344cc5c67c
Sep 28 18:30:20 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:20 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9cec820f-b4b1-4752-8da8-c6e8e06b73da tempest-VolumeDependencyTests-1102956373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.info" returned: 0 in 0.354s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:20 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-9cec820f-b4b1-4752-8da8-c6e8e06b73da tempest-VolumeDependencyTests-1102956373 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.info is being set with open permissions: ugo+rw
Sep 28 18:30:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9cec820f-b4b1-4752-8da8-c6e8e06b73da tempest-VolumeDependencyTests-1102956373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:20 devstack sudo[108596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.info
Sep 28 18:30:20 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:20 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b4179ac-11ae-45ce-841b-e49dc4f39d05 tempest-ProjectReaderTests-527406552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-39e01c45-9bb5-4f85-b789-92344cc5c67c" returned: 0 in 0.343s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:20 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8b4179ac-11ae-45ce-841b-e49dc4f39d05 tempest-ProjectReaderTests-527406552 None] Lock "cinder-quobyte-39e01c45-9bb5-4f85-b789-92344cc5c67c" released by "delete_volume" :: held 0.839s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:20 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-8b4179ac-11ae-45ce-841b-e49dc4f39d05 tempest-ProjectReaderTests-527406552 None] Created reservations ['08a24192-77f9-4733-9d96-32a606545ab2', '99a9aa18-ba32-4fbb-b273-0b35a4b2509a', 'fbe9af12-6981-4cd3-9758-68fa72440d86', '832c5ef0-eeb8-4353-9358-2e33f9efdebc'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:30:20 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9cec820f-b4b1-4752-8da8-c6e8e06b73da tempest-VolumeDependencyTests-1102956373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.info" returned: 0 in 0.361s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9cec820f-b4b1-4752-8da8-c6e8e06b73da tempest-VolumeDependencyTests-1102956373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.539s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-601033c4-9bd9-4e33-83db-65b29466c7cc tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.144s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8b4179ac-11ae-45ce-841b-e49dc4f39d05 tempest-ProjectReaderTests-527406552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8b4179ac-11ae-45ce-841b-e49dc4f39d05 tempest-ProjectReaderTests-527406552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8b4179ac-11ae-45ce-841b-e49dc4f39d05 tempest-ProjectReaderTests-527406552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8b4179ac-11ae-45ce-841b-e49dc4f39d05 tempest-ProjectReaderTests-527406552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8b4179ac-11ae-45ce-841b-e49dc4f39d05 tempest-ProjectReaderTests-527406552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b4179ac-11ae-45ce-841b-e49dc4f39d05 tempest-ProjectReaderTests-527406552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-601033c4-9bd9-4e33-83db-65b29466c7cc tempest-ProjectMemberTests-2016434849 None] Creating offline snapshot 2d93e778-1d95-4226-a34d-f1358016b8a9 of volume 27518baa-bf8b-41d7-b58f-b4a30c204d98 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:30:20 devstack sudo[108600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:30:20 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:20 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-9cec820f-b4b1-4752-8da8-c6e8e06b73da tempest-VolumeDependencyTests-1102956373 None] Create snapshot completed successfully
Sep 28 18:30:20 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75062c6-c5b7-4586-b3d9-8af4a9f1fafc]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-601033c4-9bd9-4e33-83db-65b29466c7cc tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:20 devstack sudo[108602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98
Sep 28 18:30:20 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:21 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8b4179ac-11ae-45ce-841b-e49dc4f39d05 tempest-ProjectReaderTests-527406552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.333s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:21 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-8b4179ac-11ae-45ce-841b-e49dc4f39d05 tempest-ProjectReaderTests-527406552 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:30:21 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-8b4179ac-11ae-45ce-841b-e49dc4f39d05 tempest-ProjectReaderTests-527406552 None] Deleted volume successfully.
Sep 28 18:30:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8b4179ac-11ae-45ce-841b-e49dc4f39d05 tempest-ProjectReaderTests-527406552 None] Lock "cinder-39e01c45-9bb5-4f85-b789-92344cc5c67c-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:21 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-601033c4-9bd9-4e33-83db-65b29466c7cc tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98" returned: 0 in 0.524s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-601033c4-9bd9-4e33-83db-65b29466c7cc tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.2d93e778-1d95-4226-a34d-f1358016b8a9 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:21 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:30:21 devstack sudo[108611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.2d93e778-1d95-4226-a34d-f1358016b8a9 1G
Sep 28 18:30:21 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Flow 'volume_create_manager' (b481a116-3d93-4069-8599-1a904193314e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d78130-a426-427b-a9dd-2cd1551fc087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d78130-a426-427b-a9dd-2cd1551fc087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-899010685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45584688-a9e3-47d1-bb16-d8130e6bd804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d58b19efcfb49c89a9a113492021676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:21Z,use_quota=True,user_id='aecee5298d5b460fa8aed472bbccb9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcae785-dd28-4d98-a703-0dfb94a25748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcae785-dd28-4d98-a703-0dfb94a25748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d981682-87d8-4442-a4cd-730343b586d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d981682-87d8-4442-a4cd-730343b586d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45584688-a9e3-47d1-bb16-d8130e6bd804', 'volume_name': 'volume-45584688-a9e3-47d1-bb16-d8130e6bd804', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d193da3c-59d2-4841-9f4a-71f82be1b355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d193da3c-59d2-4841-9f4a-71f82be1b355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb7c2800-24d2-4e4f-a5a8-1fc7fc72d4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:21 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Volume 45584688-a9e3-47d1-bb16-d8130e6bd804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45584688-a9e3-47d1-bb16-d8130e6bd804', 'volume_size': 1}
Sep 28 18:30:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:21 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-601033c4-9bd9-4e33-83db-65b29466c7cc tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.2d93e778-1d95-4226-a34d-f1358016b8a9 1G" returned: 0 in 0.502s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-601033c4-9bd9-4e33-83db-65b29466c7cc tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27518baa-bf8b-41d7-b58f-b4a30c204d98 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.2d93e778-1d95-4226-a34d-f1358016b8a9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:21 devstack sudo[108617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27518baa-bf8b-41d7-b58f-b4a30c204d98 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.2d93e778-1d95-4226-a34d-f1358016b8a9
Sep 28 18:30:21 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:22 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-601033c4-9bd9-4e33-83db-65b29466c7cc tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27518baa-bf8b-41d7-b58f-b4a30c204d98 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.2d93e778-1d95-4226-a34d-f1358016b8a9" returned: 0 in 0.469s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:22 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-601033c4-9bd9-4e33-83db-65b29466c7cc tempest-ProjectMemberTests-2016434849 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.2d93e778-1d95-4226-a34d-f1358016b8a9 is being set with open permissions: ugo+rw
Sep 28 18:30:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-601033c4-9bd9-4e33-83db-65b29466c7cc tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.2d93e778-1d95-4226-a34d-f1358016b8a9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:22 devstack sudo[108623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.2d93e778-1d95-4226-a34d-f1358016b8a9
Sep 28 18:30:22 devstack sudo[108623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:22 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:30:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Flow 'volume_create_manager' (584913ae-d4e9-4719-8f10-fc5371f96e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca47a850-4532-4a17-a2ac-99cf13646d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:22 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:UPDATE=275,cinder:SELECT=192,cinder:DELETE=24,cinder:INSERT=68 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:30:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca47a850-4532-4a17-a2ac-99cf13646d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1168400835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6db395-8ba0-4e6d-b131-570053662b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347f48b5e6b04da585f42681b69bbb2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d467a1d9-9cca-4430-8a66-6c00f21cdaba,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:22Z,use_quota=True,user_id='32f6bf1bdb3c4fc4a50f20b815066d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5536db67-9406-4625-9eed-ac4a197408f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5536db67-9406-4625-9eed-ac4a197408f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (994cdc42-23c2-44bb-81cf-f37f9a2c3549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (994cdc42-23c2-44bb-81cf-f37f9a2c3549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6e6db395-8ba0-4e6d-b131-570053662b22', 'volume_name': 'volume-6e6db395-8ba0-4e6d-b131-570053662b22', 'volume_size': 1, 'snapshot_id': 'd467a1d9-9cca-4430-8a66-6c00f21cdaba'}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2104c1-d373-4bcd-a692-c548c72edb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2104c1-d373-4bcd-a692-c548c72edb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:22 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eec6fcb-639a-463e-a40d-d14c3cba5358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:22 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Volume 6e6db395-8ba0-4e6d-b131-570053662b22: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6e6db395-8ba0-4e6d-b131-570053662b22', 'volume_size': 1, 'snapshot_id': 'd467a1d9-9cca-4430-8a66-6c00f21cdaba'}
Sep 28 18:30:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:22 devstack sudo[108623]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-601033c4-9bd9-4e33-83db-65b29466c7cc tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.2d93e778-1d95-4226-a34d-f1358016b8a9" returned: 0 in 0.352s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:22 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=198,cinder:UPDATE=261,cinder:INSERT=74,cinder:DELETE=25 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:30:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-601033c4-9bd9-4e33-83db-65b29466c7cc tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:22 devstack sudo[108626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.info
Sep 28 18:30:22 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:23 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-601033c4-9bd9-4e33-83db-65b29466c7cc tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.info" returned: 0 in 0.292s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:23 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-601033c4-9bd9-4e33-83db-65b29466c7cc tempest-ProjectMemberTests-2016434849 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.info is being set with open permissions: ugo+rw
Sep 28 18:30:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-601033c4-9bd9-4e33-83db-65b29466c7cc tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:23 devstack sudo[108629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.info
Sep 28 18:30:23 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:23 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-601033c4-9bd9-4e33-83db-65b29466c7cc tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.info" returned: 0 in 0.336s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-601033c4-9bd9-4e33-83db-65b29466c7cc tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.672s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.935s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:23 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-899010685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45584688-a9e3-47d1-bb16-d8130e6bd804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d58b19efcfb49c89a9a113492021676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:21Z,use_quota=True,user_id='aecee5298d5b460fa8aed472bbccb9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:30:23 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Creating volume 45584688-a9e3-47d1-bb16-d8130e6bd804 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:30:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:23 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:23 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:23 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:30:23 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:30:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45584688-a9e3-47d1-bb16-d8130e6bd804 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:23 devstack sudo[108633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45584688-a9e3-47d1-bb16-d8130e6bd804 1073741824
Sep 28 18:30:23 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:23 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-601033c4-9bd9-4e33-83db-65b29466c7cc tempest-ProjectMemberTests-2016434849 None] Create snapshot completed successfully
Sep 28 18:30:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-aeeb93b1-cb59-4015-be08-38e0f1b1ee4b tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-2d93e778-1d95-4226-a34d-f1358016b8a9-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-aeeb93b1-cb59-4015-be08-38e0f1b1ee4b tempest-ProjectMemberTests-2016434849 None] Lock "cinder-2d93e778-1d95-4226-a34d-f1358016b8a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-aeeb93b1-cb59-4015-be08-38e0f1b1ee4b tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-27518baa-bf8b-41d7-b58f-b4a30c204d98" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-aeeb93b1-cb59-4015-be08-38e0f1b1ee4b tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-27518baa-bf8b-41d7-b58f-b4a30c204d98" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-aeeb93b1-cb59-4015-be08-38e0f1b1ee4b tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-2d93e778-1d95-4226-a34d-f1358016b8a9" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-aeeb93b1-cb59-4015-be08-38e0f1b1ee4b tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-2d93e778-1d95-4226-a34d-f1358016b8a9" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:23 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-aeeb93b1-cb59-4015-be08-38e0f1b1ee4b tempest-ProjectMemberTests-2016434849 None] Deleting offline snapshot 2d93e778-1d95-4226-a34d-f1358016b8a9 of volume 27518baa-bf8b-41d7-b58f-b4a30c204d98 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-aeeb93b1-cb59-4015-be08-38e0f1b1ee4b tempest-ProjectMemberTests-2016434849 None] snapshot_file for this snap is: volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.2d93e778-1d95-4226-a34d-f1358016b8a9 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7493150-b77e-4114-9c8a-e5b596a284cc]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aeeb93b1-cb59-4015-be08-38e0f1b1ee4b tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.2d93e778-1d95-4226-a34d-f1358016b8a9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:24 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45584688-a9e3-47d1-bb16-d8130e6bd804 1073741824" returned: 0 in 0.625s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45584688-a9e3-47d1-bb16-d8130e6bd804 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:24 devstack sudo[108641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45584688-a9e3-47d1-bb16-d8130e6bd804
Sep 28 18:30:24 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:24 devstack sudo[108640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.2d93e778-1d95-4226-a34d-f1358016b8a9
Sep 28 18:30:24 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:24 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45584688-a9e3-47d1-bb16-d8130e6bd804" returned: 0 in 0.304s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.877s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Acquiring lock "cinder-quobyte-d467a1d9-9cca-4430-8a66-6c00f21cdaba-6e6db395-8ba0-4e6d-b131-570053662b22" by "_create_volume_from_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb7c2800-24d2-4e4f-a5a8-1fc7fc72d4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45584688-a9e3-47d1-bb16-d8130e6bd804', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3d68c9-a1e7-49a5-9b5f-e89dc401a738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Lock "cinder-quobyte-d467a1d9-9cca-4430-8a66-6c00f21cdaba-6e6db395-8ba0-4e6d-b131-570053662b22" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Creating volume 6e6db395-8ba0-4e6d-b131-570053662b22 from snapshot d467a1d9-9cca-4430-8a66-6c00f21cdaba {{(pid=87046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Acquiring lock "cinder-quobyte-6e6db395-8ba0-4e6d-b131-570053662b22" by "_copy_volume_from_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:24 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Volume volume-45584688-a9e3-47d1-bb16-d8130e6bd804 (45584688-a9e3-47d1-bb16-d8130e6bd804): created successfully
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3d68c9-a1e7-49a5-9b5f-e89dc401a738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Flow 'volume_create_manager' (b481a116-3d93-4069-8599-1a904193314e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Lock "cinder-quobyte-6e6db395-8ba0-4e6d-b131-570053662b22" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] snapshot: d467a1d9-9cca-4430-8a66-6c00f21cdaba, volume: 6e6db395-8ba0-4e6d-b131-570053662b22,  {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 28 18:30:24 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-ecea9043-80d3-4e66-bc4c-bf485d90ef51 tempest-ProjectReaderTests-527406552 None] Created volume successfully.
Sep 28 18:30:24 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aeeb93b1-cb59-4015-be08-38e0f1b1ee4b tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.2d93e778-1d95-4226-a34d-f1358016b8a9" returned: 0 in 0.553s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-aeeb93b1-cb59-4015-be08-38e0f1b1ee4b tempest-ProjectMemberTests-2016434849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27518baa-bf8b-41d7-b58f-b4a30c204d98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1609d8bd-0b1a-4ea2-8388-a680ffcf6237]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9796551e-924e-4d06-b54c-9fcc1c48ed2c]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aeeb93b1-cb59-4015-be08-38e0f1b1ee4b tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:24 devstack sudo[108648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba
Sep 28 18:30:24 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:24 devstack sudo[108649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98
Sep 28 18:30:24 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:25 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba" returned: 0 in 0.456s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:25 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c9afd1a-3817-4c3d-8322-d81170df2555(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:30:25 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aeeb93b1-cb59-4015-be08-38e0f1b1ee4b tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98" returned: 0 in 0.452s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aeeb93b1-cb59-4015-be08-38e0f1b1ee4b tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.2d93e778-1d95-4226-a34d-f1358016b8a9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:25 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbebacde-76c7-4b67-9867-3413371ea36c]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:25 devstack sudo[108658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.2d93e778-1d95-4226-a34d-f1358016b8a9
Sep 28 18:30:25 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:25 devstack sudo[108660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555
Sep 28 18:30:25 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:25 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aeeb93b1-cb59-4015-be08-38e0f1b1ee4b tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.2d93e778-1d95-4226-a34d-f1358016b8a9" returned: 0 in 0.379s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aeeb93b1-cb59-4015-be08-38e0f1b1ee4b tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.2d93e778-1d95-4226-a34d-f1358016b8a9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:25 devstack sudo[108667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.2d93e778-1d95-4226-a34d-f1358016b8a9
Sep 28 18:30:25 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:25 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555" returned: 0 in 0.477s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:25 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555 {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 28 18:30:25 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Creating direct copy from snapshot {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 28 18:30:25 devstack cinder-volume[87046]: DEBUG cinder.utils [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Path /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6e6db395-8ba0-4e6d-b131-570053662b22 not found in is_blk_device check {{(pid=87046) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 28 18:30:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6e6db395-8ba0-4e6d-b131-570053662b22 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:25 devstack sudo[108670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6e6db395-8ba0-4e6d-b131-570053662b22
Sep 28 18:30:25 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-67cdfe04-d10e-4fa4-982f-b94e4c55325f tempest-ProjectReaderTests-527406552 None] Acquiring lock "cinder-45584688-a9e3-47d1-bb16-d8130e6bd804-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-67cdfe04-d10e-4fa4-982f-b94e4c55325f tempest-ProjectReaderTests-527406552 None] Lock "cinder-45584688-a9e3-47d1-bb16-d8130e6bd804-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:25 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aeeb93b1-cb59-4015-be08-38e0f1b1ee4b tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98.2d93e778-1d95-4226-a34d-f1358016b8a9" returned: 0 in 0.370s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-67cdfe04-d10e-4fa4-982f-b94e4c55325f tempest-ProjectReaderTests-527406552 None] Acquiring lock "cinder-quobyte-45584688-a9e3-47d1-bb16-d8130e6bd804" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-aeeb93b1-cb59-4015-be08-38e0f1b1ee4b tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-2d93e778-1d95-4226-a34d-f1358016b8a9" released by "_delete_snapshot" :: held 1.901s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-67cdfe04-d10e-4fa4-982f-b94e4c55325f tempest-ProjectReaderTests-527406552 None] Lock "cinder-quobyte-45584688-a9e3-47d1-bb16-d8130e6bd804" acquired by "delete_volume" :: waited 0.051s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-aeeb93b1-cb59-4015-be08-38e0f1b1ee4b tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-27518baa-bf8b-41d7-b58f-b4a30c204d98" released by "delete_snapshot" :: held 1.955s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:25 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c156d8-cdd6-4d3c-b88a-10530ab0738c]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-67cdfe04-d10e-4fa4-982f-b94e4c55325f tempest-ProjectReaderTests-527406552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45584688-a9e3-47d1-bb16-d8130e6bd804 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:26 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-aeeb93b1-cb59-4015-be08-38e0f1b1ee4b tempest-ProjectMemberTests-2016434849 None] Created reservations ['4f9aadd1-1daa-4bbd-a87c-e20570732f8b', '01fa6add-b7ea-49df-8093-6da8229c2156', '8546694f-b5ce-49d3-b96e-5e6963be31f8', '5a0705c5-41a1-40e6-bce3-c781017515a4'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:30:26 devstack sudo[108677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45584688-a9e3-47d1-bb16-d8130e6bd804
Sep 28 18:30:26 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:26 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-aeeb93b1-cb59-4015-be08-38e0f1b1ee4b tempest-ProjectMemberTests-2016434849 None] Delete snapshot completed successfully.
Sep 28 18:30:26 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-aeeb93b1-cb59-4015-be08-38e0f1b1ee4b tempest-ProjectMemberTests-2016434849 None] Lock "cinder-2d93e778-1d95-4226-a34d-f1358016b8a9-delete_snapshot" released by "delete_snapshot" :: held 2.222s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:26 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-67cdfe04-d10e-4fa4-982f-b94e4c55325f tempest-ProjectReaderTests-527406552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45584688-a9e3-47d1-bb16-d8130e6bd804" returned: 0 in 0.802s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-67cdfe04-d10e-4fa4-982f-b94e4c55325f tempest-ProjectReaderTests-527406552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45584688-a9e3-47d1-bb16-d8130e6bd804 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:26 devstack sudo[108689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45584688-a9e3-47d1-bb16-d8130e6bd804
Sep 28 18:30:26 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:27 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c1cd54fb-338d-4149-943c-879daa90ffcd tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-27518baa-bf8b-41d7-b58f-b4a30c204d98-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:27 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c1cd54fb-338d-4149-943c-879daa90ffcd tempest-ProjectMemberTests-2016434849 None] Lock "cinder-27518baa-bf8b-41d7-b58f-b4a30c204d98-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:27 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c1cd54fb-338d-4149-943c-879daa90ffcd tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-27518baa-bf8b-41d7-b58f-b4a30c204d98" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:27 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-67cdfe04-d10e-4fa4-982f-b94e4c55325f tempest-ProjectReaderTests-527406552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-45584688-a9e3-47d1-bb16-d8130e6bd804" returned: 0 in 0.734s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:27 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c1cd54fb-338d-4149-943c-879daa90ffcd tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-27518baa-bf8b-41d7-b58f-b4a30c204d98" acquired by "delete_volume" :: waited 0.068s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:27 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-67cdfe04-d10e-4fa4-982f-b94e4c55325f tempest-ProjectReaderTests-527406552 None] Lock "cinder-quobyte-45584688-a9e3-47d1-bb16-d8130e6bd804" released by "delete_volume" :: held 1.711s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:27 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f6f4c6-a2af-4842-ae3b-1b6a77ebe979]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c1cd54fb-338d-4149-943c-879daa90ffcd tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:27 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-67cdfe04-d10e-4fa4-982f-b94e4c55325f tempest-ProjectReaderTests-527406552 None] Created reservations ['4b3a19eb-2c13-4ba4-bacf-2065c26947cb', '2ce6399f-aca3-4247-b954-ca3b23514489', '5f009428-6753-4f2a-ba65-9cb218320003', 'ef569a82-4fd9-47a0-b63a-847934771049'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:30:27 devstack sudo[108692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98
Sep 28 18:30:27 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-67cdfe04-d10e-4fa4-982f-b94e4c55325f tempest-ProjectReaderTests-527406552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-67cdfe04-d10e-4fa4-982f-b94e4c55325f tempest-ProjectReaderTests-527406552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-67cdfe04-d10e-4fa4-982f-b94e4c55325f tempest-ProjectReaderTests-527406552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-67cdfe04-d10e-4fa4-982f-b94e4c55325f tempest-ProjectReaderTests-527406552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-67cdfe04-d10e-4fa4-982f-b94e4c55325f tempest-ProjectReaderTests-527406552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-67cdfe04-d10e-4fa4-982f-b94e4c55325f tempest-ProjectReaderTests-527406552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:28 devstack sudo[108694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:30:28 devstack sudo[108694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:28 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c1cd54fb-338d-4149-943c-879daa90ffcd tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98" returned: 0 in 0.846s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c1cd54fb-338d-4149-943c-879daa90ffcd tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:28 devstack sudo[108699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98
Sep 28 18:30:28 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:28 devstack sudo[108694]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-67cdfe04-d10e-4fa4-982f-b94e4c55325f tempest-ProjectReaderTests-527406552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.853s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:28 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-67cdfe04-d10e-4fa4-982f-b94e4c55325f tempest-ProjectReaderTests-527406552 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:30:28 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-67cdfe04-d10e-4fa4-982f-b94e4c55325f tempest-ProjectReaderTests-527406552 None] Deleted volume successfully.
Sep 28 18:30:28 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-67cdfe04-d10e-4fa4-982f-b94e4c55325f tempest-ProjectReaderTests-527406552 None] Lock "cinder-45584688-a9e3-47d1-bb16-d8130e6bd804-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:29 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c1cd54fb-338d-4149-943c-879daa90ffcd tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-27518baa-bf8b-41d7-b58f-b4a30c204d98" returned: 0 in 0.782s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:29 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c1cd54fb-338d-4149-943c-879daa90ffcd tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-27518baa-bf8b-41d7-b58f-b4a30c204d98" released by "delete_volume" :: held 1.772s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:29 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-c1cd54fb-338d-4149-943c-879daa90ffcd tempest-ProjectMemberTests-2016434849 None] Created reservations ['c2675f27-7f76-4948-b2d9-75432e25d5c6', '33d21a53-d9fb-462f-8604-d30f26b26734', '45fd68e0-3deb-4eb6-8b84-f234b7958290', 'd54ef1ce-2803-454a-9d59-767a22768219'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:30:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c1cd54fb-338d-4149-943c-879daa90ffcd tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c1cd54fb-338d-4149-943c-879daa90ffcd tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c1cd54fb-338d-4149-943c-879daa90ffcd tempest-ProjectMemberTests-2016434849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-c1cd54fb-338d-4149-943c-879daa90ffcd tempest-ProjectMemberTests-2016434849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-c1cd54fb-338d-4149-943c-879daa90ffcd tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c1cd54fb-338d-4149-943c-879daa90ffcd tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:29 devstack sudo[108703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:30:29 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:30 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c1cd54fb-338d-4149-943c-879daa90ffcd tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.790s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:30 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-c1cd54fb-338d-4149-943c-879daa90ffcd tempest-ProjectMemberTests-2016434849 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:30:30 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-c1cd54fb-338d-4149-943c-879daa90ffcd tempest-ProjectMemberTests-2016434849 None] Deleted volume successfully.
Sep 28 18:30:30 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c1cd54fb-338d-4149-943c-879daa90ffcd tempest-ProjectMemberTests-2016434849 None] Lock "cinder-27518baa-bf8b-41d7-b58f-b4a30c204d98-delete_volume" released by "delete_volume" :: held 3.134s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:31 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:30:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Flow 'volume_create_manager' (e40bfaab-c749-4bdd-9756-2b222ebe0bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da514d3-5a9c-4618-b26c-0f636872e327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da514d3-5a9c-4618-b26c-0f636872e327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1349545359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=426ef7e1-881d-4f6e-adb3-68b1571342e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7141bfada145467eb777f5e9601f614e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:31Z,use_quota=True,user_id='19ef54da5952457abebbe56a45760423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bfa4eff-87c0-4efb-8d82-3a8022f83e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bfa4eff-87c0-4efb-8d82-3a8022f83e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (905a83cb-2b4b-4afb-964a-7dcdc2c3926c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (905a83cb-2b4b-4afb-964a-7dcdc2c3926c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '426ef7e1-881d-4f6e-adb3-68b1571342e2', 'volume_name': 'volume-426ef7e1-881d-4f6e-adb3-68b1571342e2', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9446d3e4-e433-409e-a8e3-ca7472690d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9446d3e4-e433-409e-a8e3-ca7472690d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c97e8a62-28bf-46ab-80b5-576e5fe9a850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:31 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Volume 426ef7e1-881d-4f6e-adb3-68b1571342e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-426ef7e1-881d-4f6e-adb3-68b1571342e2', 'volume_size': 1}
Sep 28 18:30:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:35 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6e6db395-8ba0-4e6d-b131-570053662b22" returned: 0 in 9.552s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:35 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Image conversion details: src /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555, size 1024.00 MB, duration 9.55 sec, destination /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6e6db395-8ba0-4e6d-b131-570053662b22 {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:30:35 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Converted 1024.00 MB image at 107.19 MB/s
Sep 28 18:30:35 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6e6db395-8ba0-4e6d-b131-570053662b22 is being set with open permissions: ugo+rw
Sep 28 18:30:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6e6db395-8ba0-4e6d-b131-570053662b22 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:35 devstack sudo[108707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6e6db395-8ba0-4e6d-b131-570053662b22
Sep 28 18:30:35 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:35 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6e6db395-8ba0-4e6d-b131-570053662b22" returned: 0 in 0.500s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Lock "cinder-quobyte-6e6db395-8ba0-4e6d-b131-570053662b22" released by "_copy_volume_from_snapshot" :: held 11.127s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Lock "cinder-quobyte-d467a1d9-9cca-4430-8a66-6c00f21cdaba-6e6db395-8ba0-4e6d-b131-570053662b22" released by "_create_volume_from_snapshot" :: held 11.255s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.313s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.942s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1349545359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=426ef7e1-881d-4f6e-adb3-68b1571342e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7141bfada145467eb777f5e9601f614e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:31Z,use_quota=True,user_id='19ef54da5952457abebbe56a45760423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:30:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Creating volume 426ef7e1-881d-4f6e-adb3-68b1571342e2 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:30:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:35 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:30:35 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:30:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:35 devstack sudo[108744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2 1073741824
Sep 28 18:30:35 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eec6fcb-639a-463e-a40d-d14c3cba5358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e6db395-8ba0-4e6d-b131-570053662b22', 'volume_size': 1, 'snapshot_id': 'd467a1d9-9cca-4430-8a66-6c00f21cdaba'}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d899e2a4-a1aa-4e6a-986a-27fe0e3bf671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:35 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Volume volume-6e6db395-8ba0-4e6d-b131-570053662b22 (6e6db395-8ba0-4e6d-b131-570053662b22): created successfully
Sep 28 18:30:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d899e2a4-a1aa-4e6a-986a-27fe0e3bf671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:35 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Flow 'volume_create_manager' (584913ae-d4e9-4719-8f10-fc5371f96e26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:35 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-ae814a2c-7e8c-4a22-965d-f284bd250b31 tempest-VolumeDependencyTests-1102956373 None] Created volume successfully.
Sep 28 18:30:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0f552434-d713-4267-a248-621da21b8312 tempest-VolumeDependencyTests-1102956373 None] Acquiring lock "cinder-d467a1d9-9cca-4430-8a66-6c00f21cdaba-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0f552434-d713-4267-a248-621da21b8312 tempest-VolumeDependencyTests-1102956373 None] Lock "cinder-d467a1d9-9cca-4430-8a66-6c00f21cdaba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0f552434-d713-4267-a248-621da21b8312 tempest-VolumeDependencyTests-1102956373 None] Acquiring lock "cinder-quobyte-8c9afd1a-3817-4c3d-8322-d81170df2555" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0f552434-d713-4267-a248-621da21b8312 tempest-VolumeDependencyTests-1102956373 None] Lock "cinder-quobyte-8c9afd1a-3817-4c3d-8322-d81170df2555" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0f552434-d713-4267-a248-621da21b8312 tempest-VolumeDependencyTests-1102956373 None] Acquiring lock "cinder-quobyte-d467a1d9-9cca-4430-8a66-6c00f21cdaba" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0f552434-d713-4267-a248-621da21b8312 tempest-VolumeDependencyTests-1102956373 None] Lock "cinder-quobyte-d467a1d9-9cca-4430-8a66-6c00f21cdaba" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-0f552434-d713-4267-a248-621da21b8312 tempest-VolumeDependencyTests-1102956373 None] Deleting offline snapshot d467a1d9-9cca-4430-8a66-6c00f21cdaba of volume 8c9afd1a-3817-4c3d-8322-d81170df2555 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:30:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-0f552434-d713-4267-a248-621da21b8312 tempest-VolumeDependencyTests-1102956373 None] snapshot_file for this snap is: volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:30:36 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[902a9054-2c53-48cc-a5ce-3028e9993307]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0f552434-d713-4267-a248-621da21b8312 tempest-VolumeDependencyTests-1102956373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:36 devstack sudo[108750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba
Sep 28 18:30:36 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:36 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2 1073741824" returned: 0 in 1.133s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:36 devstack sudo[108757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2
Sep 28 18:30:36 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:37 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0f552434-d713-4267-a248-621da21b8312 tempest-VolumeDependencyTests-1102956373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba" returned: 0 in 0.629s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-0f552434-d713-4267-a248-621da21b8312 tempest-VolumeDependencyTests-1102956373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c9afd1a-3817-4c3d-8322-d81170df2555(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:30:37 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff006b24-59f0-4040-a160-e320de5938fc]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0f552434-d713-4267-a248-621da21b8312 tempest-VolumeDependencyTests-1102956373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:37 devstack sudo[108761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555
Sep 28 18:30:37 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:37 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2" returned: 0 in 0.547s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:30:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c97e8a62-28bf-46ab-80b5-576e5fe9a850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-426ef7e1-881d-4f6e-adb3-68b1571342e2', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcbb05d0-9980-4f4a-8e5d-4c80542691dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:37 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Volume volume-426ef7e1-881d-4f6e-adb3-68b1571342e2 (426ef7e1-881d-4f6e-adb3-68b1571342e2): created successfully
Sep 28 18:30:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcbb05d0-9980-4f4a-8e5d-4c80542691dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Flow 'volume_create_manager' (e40bfaab-c749-4bdd-9756-2b222ebe0bb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:37 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-97bf102e-17c4-468f-9356-ba2015893e11 tempest-ProjectMemberTests-2016434849 None] Created volume successfully.
Sep 28 18:30:37 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0f552434-d713-4267-a248-621da21b8312 tempest-VolumeDependencyTests-1102956373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555" returned: 0 in 0.754s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0f552434-d713-4267-a248-621da21b8312 tempest-VolumeDependencyTests-1102956373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:37 devstack sudo[108767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba
Sep 28 18:30:37 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Flow 'volume_create_manager' (b421ac02-6848-479d-af4d-919f6d13d8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3358d895-8020-4e73-918a-49db821620ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3358d895-8020-4e73-918a-49db821620ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-148810036',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9b501b-c9a6-4a18-b452-e18d075c33ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da056a4fd1e748f88f9289ddd0dce4d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:38Z,use_quota=True,user_id='f7bc483a2a324dc2b22adfac8347b91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a192f1e6-191a-410e-bafa-2dfd0f0a2bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a192f1e6-191a-410e-bafa-2dfd0f0a2bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb16739-458a-42ff-b77f-91e2f8962a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb16739-458a-42ff-b77f-91e2f8962a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac9b501b-c9a6-4a18-b452-e18d075c33ba', 'volume_name': 'volume-ac9b501b-c9a6-4a18-b452-e18d075c33ba', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:38 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2177a2-05b1-4175-a1f8-1fa663e575b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2177a2-05b1-4175-a1f8-1fa663e575b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7fafcdc-3851-471e-9458-86dcc3f4c627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:38 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Volume ac9b501b-c9a6-4a18-b452-e18d075c33ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac9b501b-c9a6-4a18-b452-e18d075c33ba', 'volume_size': 1}
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-148810036',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9b501b-c9a6-4a18-b452-e18d075c33ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da056a4fd1e748f88f9289ddd0dce4d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:38Z,use_quota=True,user_id='f7bc483a2a324dc2b22adfac8347b91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Creating volume ac9b501b-c9a6-4a18-b452-e18d075c33ba {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:30:38 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ac9b501b-c9a6-4a18-b452-e18d075c33ba 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0f552434-d713-4267-a248-621da21b8312 tempest-VolumeDependencyTests-1102956373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba" returned: 0 in 0.717s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0f552434-d713-4267-a248-621da21b8312 tempest-VolumeDependencyTests-1102956373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-42a83f20-ea3a-49ac-87e9-23a807f18a0f tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:38 devstack sudo[108774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba
Sep 28 18:30:38 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:38 devstack sudo[108773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ac9b501b-c9a6-4a18-b452-e18d075c33ba 1073741824
Sep 28 18:30:38 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:38 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-0f552434-d713-4267-a248-621da21b8312 tempest-VolumeDependencyTests-1102956373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555.d467a1d9-9cca-4430-8a66-6c00f21cdaba" returned: 0 in 0.327s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0f552434-d713-4267-a248-621da21b8312 tempest-VolumeDependencyTests-1102956373 None] Lock "cinder-quobyte-d467a1d9-9cca-4430-8a66-6c00f21cdaba" released by "_delete_snapshot" :: held 2.611s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0f552434-d713-4267-a248-621da21b8312 tempest-VolumeDependencyTests-1102956373 None] Lock "cinder-quobyte-8c9afd1a-3817-4c3d-8322-d81170df2555" released by "delete_snapshot" :: held 2.657s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-0f552434-d713-4267-a248-621da21b8312 tempest-VolumeDependencyTests-1102956373 None] Created reservations ['df2a59a9-b168-4b6c-beb1-d2dae4929fdb', '9e89c4cb-0e5e-44c6-a25c-4de947a3975c', 'c1a23e9a-fce6-475a-bd7e-b279e18f2c9c', '8e81fa37-4b02-4c0e-bcb3-357668bb043c'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:30:39 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ac9b501b-c9a6-4a18-b452-e18d075c33ba 1073741824" returned: 0 in 0.564s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:39 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-0f552434-d713-4267-a248-621da21b8312 tempest-VolumeDependencyTests-1102956373 None] Delete snapshot completed successfully.
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-0f552434-d713-4267-a248-621da21b8312 tempest-VolumeDependencyTests-1102956373 None] Lock "cinder-d467a1d9-9cca-4430-8a66-6c00f21cdaba-delete_snapshot" released by "delete_snapshot" :: held 2.907s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ac9b501b-c9a6-4a18-b452-e18d075c33ba {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:39 devstack sudo[108782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ac9b501b-c9a6-4a18-b452-e18d075c33ba
Sep 28 18:30:39 devstack sudo[108782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:39 devstack sudo[108785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:30:39 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:39 devstack sudo[108782]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ac9b501b-c9a6-4a18-b452-e18d075c33ba" returned: 0 in 0.279s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-42a83f20-ea3a-49ac-87e9-23a807f18a0f tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.842s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7fafcdc-3851-471e-9458-86dcc3f4c627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac9b501b-c9a6-4a18-b452-e18d075c33ba', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce4c948-3520-4ac2-b002-435cba40d166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-42a83f20-ea3a-49ac-87e9-23a807f18a0f tempest-ProjectMemberTests-2016434849 None] Creating offline snapshot f33739d1-858f-4a66-909f-3bd5041145bd of volume 426ef7e1-881d-4f6e-adb3-68b1571342e2 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:30:39 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Volume volume-ac9b501b-c9a6-4a18-b452-e18d075c33ba (ac9b501b-c9a6-4a18-b452-e18d075c33ba): created successfully
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce4c948-3520-4ac2-b002-435cba40d166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Flow 'volume_create_manager' (b421ac02-6848-479d-af4d-919f6d13d8d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9937eb10-8c7b-4abd-8321-41226713bd76]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-42a83f20-ea3a-49ac-87e9-23a807f18a0f tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:39 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-1e6a278a-89ec-4cb9-8e8d-7f7fdf635a43 tempest-ProjectReaderTests-1169210101 None] Created volume successfully.
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-682532d1-609f-4505-bf04-1ecf24975ffb tempest-VolumeDependencyTests-1102956373 None] Acquiring lock "cinder-8c9afd1a-3817-4c3d-8322-d81170df2555-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-682532d1-609f-4505-bf04-1ecf24975ffb tempest-VolumeDependencyTests-1102956373 None] Lock "cinder-8c9afd1a-3817-4c3d-8322-d81170df2555-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-682532d1-609f-4505-bf04-1ecf24975ffb tempest-VolumeDependencyTests-1102956373 None] Acquiring lock "cinder-quobyte-8c9afd1a-3817-4c3d-8322-d81170df2555" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-682532d1-609f-4505-bf04-1ecf24975ffb tempest-VolumeDependencyTests-1102956373 None] Lock "cinder-quobyte-8c9afd1a-3817-4c3d-8322-d81170df2555" acquired by "delete_volume" :: waited 0.031s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:39 devstack sudo[108787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2
Sep 28 18:30:39 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ca294a-0536-404d-a8d5-41b380cdcc0e]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:39 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-682532d1-609f-4505-bf04-1ecf24975ffb tempest-VolumeDependencyTests-1102956373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.406s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:30:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:30:39 devstack sudo[108790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555
Sep 28 18:30:39 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:40 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-42a83f20-ea3a-49ac-87e9-23a807f18a0f tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2" returned: 0 in 0.548s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-42a83f20-ea3a-49ac-87e9-23a807f18a0f tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.f33739d1-858f-4a66-909f-3bd5041145bd 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:40 devstack sudo[108795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.f33739d1-858f-4a66-909f-3bd5041145bd 1G
Sep 28 18:30:40 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:40 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-682532d1-609f-4505-bf04-1ecf24975ffb tempest-VolumeDependencyTests-1102956373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555" returned: 0 in 0.506s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-682532d1-609f-4505-bf04-1ecf24975ffb tempest-VolumeDependencyTests-1102956373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:40 devstack sudo[108800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555
Sep 28 18:30:40 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-df8aca73-b48b-4fce-ba86-a02dc54edd40 tempest-ProjectReaderTests-1169210101 None] Acquiring lock "cinder-ac9b501b-c9a6-4a18-b452-e18d075c33ba-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-df8aca73-b48b-4fce-ba86-a02dc54edd40 tempest-ProjectReaderTests-1169210101 None] Lock "cinder-ac9b501b-c9a6-4a18-b452-e18d075c33ba-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:40 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-42a83f20-ea3a-49ac-87e9-23a807f18a0f tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.f33739d1-858f-4a66-909f-3bd5041145bd 1G" returned: 0 in 0.585s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-42a83f20-ea3a-49ac-87e9-23a807f18a0f tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-426ef7e1-881d-4f6e-adb3-68b1571342e2 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.f33739d1-858f-4a66-909f-3bd5041145bd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:40 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-682532d1-609f-4505-bf04-1ecf24975ffb tempest-VolumeDependencyTests-1102956373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-8c9afd1a-3817-4c3d-8322-d81170df2555" returned: 0 in 0.406s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:40 devstack sudo[108807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-426ef7e1-881d-4f6e-adb3-68b1571342e2 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.f33739d1-858f-4a66-909f-3bd5041145bd
Sep 28 18:30:40 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-682532d1-609f-4505-bf04-1ecf24975ffb tempest-VolumeDependencyTests-1102956373 None] Lock "cinder-quobyte-8c9afd1a-3817-4c3d-8322-d81170df2555" released by "delete_volume" :: held 1.030s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-df8aca73-b48b-4fce-ba86-a02dc54edd40 tempest-ProjectReaderTests-1169210101 None] Acquiring lock "cinder-quobyte-ac9b501b-c9a6-4a18-b452-e18d075c33ba" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-df8aca73-b48b-4fce-ba86-a02dc54edd40 tempest-ProjectReaderTests-1169210101 None] Lock "cinder-quobyte-ac9b501b-c9a6-4a18-b452-e18d075c33ba" acquired by "delete_volume" :: waited 0.032s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:40 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[612c8bf4-f25a-4de1-8251-47edfec740d3]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-df8aca73-b48b-4fce-ba86-a02dc54edd40 tempest-ProjectReaderTests-1169210101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ac9b501b-c9a6-4a18-b452-e18d075c33ba {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:40 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-682532d1-609f-4505-bf04-1ecf24975ffb tempest-VolumeDependencyTests-1102956373 None] Created reservations ['67877c32-d7a1-4160-b77c-a6d71774507c', '3f198ed7-5708-409f-907c-7c3e05a76c39', '6388fcdd-1ca1-4d27-b5e5-5280e4595852', 'ba9db193-6caa-4696-819e-b3a5b51fec0f'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-682532d1-609f-4505-bf04-1ecf24975ffb tempest-VolumeDependencyTests-1102956373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-682532d1-609f-4505-bf04-1ecf24975ffb tempest-VolumeDependencyTests-1102956373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-682532d1-609f-4505-bf04-1ecf24975ffb tempest-VolumeDependencyTests-1102956373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-682532d1-609f-4505-bf04-1ecf24975ffb tempest-VolumeDependencyTests-1102956373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:41 devstack sudo[108809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ac9b501b-c9a6-4a18-b452-e18d075c33ba
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-682532d1-609f-4505-bf04-1ecf24975ffb tempest-VolumeDependencyTests-1102956373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-682532d1-609f-4505-bf04-1ecf24975ffb tempest-VolumeDependencyTests-1102956373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:41 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:41 devstack sudo[108813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:30:41 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:41 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-42a83f20-ea3a-49ac-87e9-23a807f18a0f tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-426ef7e1-881d-4f6e-adb3-68b1571342e2 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.f33739d1-858f-4a66-909f-3bd5041145bd" returned: 0 in 0.492s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:41 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-42a83f20-ea3a-49ac-87e9-23a807f18a0f tempest-ProjectMemberTests-2016434849 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.f33739d1-858f-4a66-909f-3bd5041145bd is being set with open permissions: ugo+rw
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-42a83f20-ea3a-49ac-87e9-23a807f18a0f tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.f33739d1-858f-4a66-909f-3bd5041145bd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:41 devstack sudo[108816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.f33739d1-858f-4a66-909f-3bd5041145bd
Sep 28 18:30:41 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:41 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-682532d1-609f-4505-bf04-1ecf24975ffb tempest-VolumeDependencyTests-1102956373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.365s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-682532d1-609f-4505-bf04-1ecf24975ffb tempest-VolumeDependencyTests-1102956373 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:30:41 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-682532d1-609f-4505-bf04-1ecf24975ffb tempest-VolumeDependencyTests-1102956373 None] Deleted volume successfully.
Sep 28 18:30:41 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-df8aca73-b48b-4fce-ba86-a02dc54edd40 tempest-ProjectReaderTests-1169210101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ac9b501b-c9a6-4a18-b452-e18d075c33ba" returned: 0 in 0.554s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-df8aca73-b48b-4fce-ba86-a02dc54edd40 tempest-ProjectReaderTests-1169210101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ac9b501b-c9a6-4a18-b452-e18d075c33ba {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-682532d1-609f-4505-bf04-1ecf24975ffb tempest-VolumeDependencyTests-1102956373 None] Lock "cinder-8c9afd1a-3817-4c3d-8322-d81170df2555-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:41 devstack sudo[108822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ac9b501b-c9a6-4a18-b452-e18d075c33ba
Sep 28 18:30:41 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:41 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-42a83f20-ea3a-49ac-87e9-23a807f18a0f tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.f33739d1-858f-4a66-909f-3bd5041145bd" returned: 0 in 0.316s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-42a83f20-ea3a-49ac-87e9-23a807f18a0f tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:41 devstack sudo[108825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.info
Sep 28 18:30:41 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:41 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-df8aca73-b48b-4fce-ba86-a02dc54edd40 tempest-ProjectReaderTests-1169210101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ac9b501b-c9a6-4a18-b452-e18d075c33ba" returned: 0 in 0.291s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-df8aca73-b48b-4fce-ba86-a02dc54edd40 tempest-ProjectReaderTests-1169210101 None] Lock "cinder-quobyte-ac9b501b-c9a6-4a18-b452-e18d075c33ba" released by "delete_volume" :: held 0.904s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-df8aca73-b48b-4fce-ba86-a02dc54edd40 tempest-ProjectReaderTests-1169210101 None] Created reservations ['c33865df-9689-4a4c-8fd9-87646a605040', '065b5eaa-1c44-42a6-bda5-044ed7ed0065', 'd3ccea39-6db7-4322-a743-4aad6ed6b4f3', '02a4c7f5-401f-489d-8e2b-4370b04286b4'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:30:41 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-42a83f20-ea3a-49ac-87e9-23a807f18a0f tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.info" returned: 0 in 0.341s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:41 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-42a83f20-ea3a-49ac-87e9-23a807f18a0f tempest-ProjectMemberTests-2016434849 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.info is being set with open permissions: ugo+rw
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-42a83f20-ea3a-49ac-87e9-23a807f18a0f tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:41 devstack sudo[108829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.info
Sep 28 18:30:41 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-df8aca73-b48b-4fce-ba86-a02dc54edd40 tempest-ProjectReaderTests-1169210101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-df8aca73-b48b-4fce-ba86-a02dc54edd40 tempest-ProjectReaderTests-1169210101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-df8aca73-b48b-4fce-ba86-a02dc54edd40 tempest-ProjectReaderTests-1169210101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-df8aca73-b48b-4fce-ba86-a02dc54edd40 tempest-ProjectReaderTests-1169210101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-df8aca73-b48b-4fce-ba86-a02dc54edd40 tempest-ProjectReaderTests-1169210101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-df8aca73-b48b-4fce-ba86-a02dc54edd40 tempest-ProjectReaderTests-1169210101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:42 devstack sudo[108831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:30:42 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2c290806-5f27-4412-93bc-050f29ebf648 tempest-VolumeDependencyTests-1102956373 None] Acquiring lock "cinder-6e6db395-8ba0-4e6d-b131-570053662b22-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2c290806-5f27-4412-93bc-050f29ebf648 tempest-VolumeDependencyTests-1102956373 None] Lock "cinder-6e6db395-8ba0-4e6d-b131-570053662b22-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2c290806-5f27-4412-93bc-050f29ebf648 tempest-VolumeDependencyTests-1102956373 None] Acquiring lock "cinder-quobyte-6e6db395-8ba0-4e6d-b131-570053662b22" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2c290806-5f27-4412-93bc-050f29ebf648 tempest-VolumeDependencyTests-1102956373 None] Lock "cinder-quobyte-6e6db395-8ba0-4e6d-b131-570053662b22" acquired by "delete_volume" :: waited 0.034s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:42 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-42a83f20-ea3a-49ac-87e9-23a807f18a0f tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.info" returned: 0 in 0.345s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-42a83f20-ea3a-49ac-87e9-23a807f18a0f tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.789s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd34a3a-c9ad-4311-9723-f23f864ee260]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2c290806-5f27-4412-93bc-050f29ebf648 tempest-VolumeDependencyTests-1102956373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6e6db395-8ba0-4e6d-b131-570053662b22 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:42 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-42a83f20-ea3a-49ac-87e9-23a807f18a0f tempest-ProjectMemberTests-2016434849 None] Create snapshot completed successfully
Sep 28 18:30:42 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-df8aca73-b48b-4fce-ba86-a02dc54edd40 tempest-ProjectReaderTests-1169210101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.420s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-df8aca73-b48b-4fce-ba86-a02dc54edd40 tempest-ProjectReaderTests-1169210101 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:30:42 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-df8aca73-b48b-4fce-ba86-a02dc54edd40 tempest-ProjectReaderTests-1169210101 None] Deleted volume successfully.
Sep 28 18:30:42 devstack sudo[108834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6e6db395-8ba0-4e6d-b131-570053662b22
Sep 28 18:30:42 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-df8aca73-b48b-4fce-ba86-a02dc54edd40 tempest-ProjectReaderTests-1169210101 None] Lock "cinder-ac9b501b-c9a6-4a18-b452-e18d075c33ba-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:42 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2c290806-5f27-4412-93bc-050f29ebf648 tempest-VolumeDependencyTests-1102956373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6e6db395-8ba0-4e6d-b131-570053662b22" returned: 0 in 0.415s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2c290806-5f27-4412-93bc-050f29ebf648 tempest-VolumeDependencyTests-1102956373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6e6db395-8ba0-4e6d-b131-570053662b22 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:42 devstack sudo[108841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6e6db395-8ba0-4e6d-b131-570053662b22
Sep 28 18:30:42 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-795ce1fb-56cc-4e55-8b23-b9604706a166 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-f33739d1-858f-4a66-909f-3bd5041145bd-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-795ce1fb-56cc-4e55-8b23-b9604706a166 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-f33739d1-858f-4a66-909f-3bd5041145bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-795ce1fb-56cc-4e55-8b23-b9604706a166 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-426ef7e1-881d-4f6e-adb3-68b1571342e2" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-795ce1fb-56cc-4e55-8b23-b9604706a166 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-426ef7e1-881d-4f6e-adb3-68b1571342e2" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-795ce1fb-56cc-4e55-8b23-b9604706a166 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-f33739d1-858f-4a66-909f-3bd5041145bd" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-795ce1fb-56cc-4e55-8b23-b9604706a166 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-f33739d1-858f-4a66-909f-3bd5041145bd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-795ce1fb-56cc-4e55-8b23-b9604706a166 tempest-ProjectMemberTests-2016434849 None] Deleting offline snapshot f33739d1-858f-4a66-909f-3bd5041145bd of volume 426ef7e1-881d-4f6e-adb3-68b1571342e2 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-795ce1fb-56cc-4e55-8b23-b9604706a166 tempest-ProjectMemberTests-2016434849 None] snapshot_file for this snap is: volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.f33739d1-858f-4a66-909f-3bd5041145bd {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2e972e-696a-4a2e-9e26-3987a7c1ffe3]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-795ce1fb-56cc-4e55-8b23-b9604706a166 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.f33739d1-858f-4a66-909f-3bd5041145bd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:43 devstack sudo[108843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.f33739d1-858f-4a66-909f-3bd5041145bd
Sep 28 18:30:43 devstack sudo[108843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:43 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2c290806-5f27-4412-93bc-050f29ebf648 tempest-VolumeDependencyTests-1102956373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-6e6db395-8ba0-4e6d-b131-570053662b22" returned: 0 in 0.360s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2c290806-5f27-4412-93bc-050f29ebf648 tempest-VolumeDependencyTests-1102956373 None] Lock "cinder-quobyte-6e6db395-8ba0-4e6d-b131-570053662b22" released by "delete_volume" :: held 0.902s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-2c290806-5f27-4412-93bc-050f29ebf648 tempest-VolumeDependencyTests-1102956373 None] Created reservations ['d1c586e2-1b24-4da2-8074-770789cc7e1e', 'd52adf9f-4c4c-476d-8f13-1aee499fdf48', '89de66db-b377-45e8-ac0b-6a475cc7a8c5', '120e3a3c-a954-406d-9907-9b4648479604'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2c290806-5f27-4412-93bc-050f29ebf648 tempest-VolumeDependencyTests-1102956373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2c290806-5f27-4412-93bc-050f29ebf648 tempest-VolumeDependencyTests-1102956373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2c290806-5f27-4412-93bc-050f29ebf648 tempest-VolumeDependencyTests-1102956373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2c290806-5f27-4412-93bc-050f29ebf648 tempest-VolumeDependencyTests-1102956373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2c290806-5f27-4412-93bc-050f29ebf648 tempest-VolumeDependencyTests-1102956373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2c290806-5f27-4412-93bc-050f29ebf648 tempest-VolumeDependencyTests-1102956373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:43 devstack sudo[108850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:30:43 devstack sudo[108850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:43 devstack sudo[108843]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-795ce1fb-56cc-4e55-8b23-b9604706a166 tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.f33739d1-858f-4a66-909f-3bd5041145bd" returned: 0 in 0.542s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-795ce1fb-56cc-4e55-8b23-b9604706a166 tempest-ProjectMemberTests-2016434849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-426ef7e1-881d-4f6e-adb3-68b1571342e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1dcbf7-9813-4dbb-8d91-9d8bc23a6504]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-795ce1fb-56cc-4e55-8b23-b9604706a166 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:43 devstack sudo[108852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2
Sep 28 18:30:43 devstack sudo[108852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:43 devstack sudo[108850]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2c290806-5f27-4412-93bc-050f29ebf648 tempest-VolumeDependencyTests-1102956373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.335s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-2c290806-5f27-4412-93bc-050f29ebf648 tempest-VolumeDependencyTests-1102956373 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:30:43 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-2c290806-5f27-4412-93bc-050f29ebf648 tempest-VolumeDependencyTests-1102956373 None] Deleted volume successfully.
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Flow 'volume_create_manager' (0fdeb540-df35-4f5f-9afd-3f9052741dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b698dbe-4ae1-42df-9e97-27d97c6b06a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b698dbe-4ae1-42df-9e97-27d97c6b06a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-805543800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a49377a8-c85b-4e9c-a30b-fc024261622b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da056a4fd1e748f88f9289ddd0dce4d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:44Z,use_quota=True,user_id='f7bc483a2a324dc2b22adfac8347b91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b952c7b-7cee-4910-9b14-8a515d8f0e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b952c7b-7cee-4910-9b14-8a515d8f0e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718672cb-3965-4c2e-bc8d-4424b05d9b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718672cb-3965-4c2e-bc8d-4424b05d9b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a49377a8-c85b-4e9c-a30b-fc024261622b', 'volume_name': 'volume-a49377a8-c85b-4e9c-a30b-fc024261622b', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe859a2-7e7b-4e6e-828a-3555c06e18e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe859a2-7e7b-4e6e-828a-3555c06e18e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b583c49-e092-4175-8858-acd92a8567ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:43 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Volume a49377a8-c85b-4e9c-a30b-fc024261622b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a49377a8-c85b-4e9c-a30b-fc024261622b', 'volume_size': 1}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-805543800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a49377a8-c85b-4e9c-a30b-fc024261622b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da056a4fd1e748f88f9289ddd0dce4d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:44Z,use_quota=True,user_id='f7bc483a2a324dc2b22adfac8347b91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Creating volume a49377a8-c85b-4e9c-a30b-fc024261622b {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:30:43 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a49377a8-c85b-4e9c-a30b-fc024261622b 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:43 devstack sudo[108855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a49377a8-c85b-4e9c-a30b-fc024261622b 1073741824
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2c290806-5f27-4412-93bc-050f29ebf648 tempest-VolumeDependencyTests-1102956373 None] Lock "cinder-6e6db395-8ba0-4e6d-b131-570053662b22-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:43 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:43 devstack sudo[108852]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-795ce1fb-56cc-4e55-8b23-b9604706a166 tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2" returned: 0 in 0.456s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-795ce1fb-56cc-4e55-8b23-b9604706a166 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.f33739d1-858f-4a66-909f-3bd5041145bd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:44 devstack sudo[108860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.f33739d1-858f-4a66-909f-3bd5041145bd
Sep 28 18:30:44 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:44 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:44 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a49377a8-c85b-4e9c-a30b-fc024261622b 1073741824" returned: 0 in 0.582s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-795ce1fb-56cc-4e55-8b23-b9604706a166 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.f33739d1-858f-4a66-909f-3bd5041145bd" returned: 0 in 0.436s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-795ce1fb-56cc-4e55-8b23-b9604706a166 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.f33739d1-858f-4a66-909f-3bd5041145bd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:44 devstack sudo[108870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.f33739d1-858f-4a66-909f-3bd5041145bd
Sep 28 18:30:44 devstack sudo[108870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a49377a8-c85b-4e9c-a30b-fc024261622b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:44 devstack sudo[108872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a49377a8-c85b-4e9c-a30b-fc024261622b
Sep 28 18:30:44 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:44 devstack sudo[108870]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-795ce1fb-56cc-4e55-8b23-b9604706a166 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2.f33739d1-858f-4a66-909f-3bd5041145bd" returned: 0 in 0.394s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:44 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a49377a8-c85b-4e9c-a30b-fc024261622b" returned: 0 in 0.365s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:44 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:30:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-795ce1fb-56cc-4e55-8b23-b9604706a166 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-f33739d1-858f-4a66-909f-3bd5041145bd" released by "_delete_snapshot" :: held 2.002s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-795ce1fb-56cc-4e55-8b23-b9604706a166 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-426ef7e1-881d-4f6e-adb3-68b1571342e2" released by "delete_snapshot" :: held 2.037s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b583c49-e092-4175-8858-acd92a8567ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a49377a8-c85b-4e9c-a30b-fc024261622b', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3679df0e-a51f-45fd-b589-9869e939a4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:44 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Volume volume-a49377a8-c85b-4e9c-a30b-fc024261622b (a49377a8-c85b-4e9c-a30b-fc024261622b): created successfully
Sep 28 18:30:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3679df0e-a51f-45fd-b589-9869e939a4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:44 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Flow 'volume_create_manager' (0fdeb540-df35-4f5f-9afd-3f9052741dc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:44 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-ff939e71-f97e-48ab-84d8-3d24ba83c07a tempest-ProjectReaderTests-1169210101 None] Created volume successfully.
Sep 28 18:30:44 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-795ce1fb-56cc-4e55-8b23-b9604706a166 tempest-ProjectMemberTests-2016434849 None] Created reservations ['4ac11592-711e-43e7-937b-9862e416f02a', 'afb374ba-9e3a-40f6-8e48-8be2ec2603db', '67081045-a9b0-47fd-a185-7e6c7e3e72f0', '7dbf69f4-997b-4e7f-ae66-6239efdf9910'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:30:45 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-795ce1fb-56cc-4e55-8b23-b9604706a166 tempest-ProjectMemberTests-2016434849 None] Delete snapshot completed successfully.
Sep 28 18:30:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-795ce1fb-56cc-4e55-8b23-b9604706a166 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-f33739d1-858f-4a66-909f-3bd5041145bd-delete_snapshot" released by "delete_snapshot" :: held 2.274s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b5e2c904-7d54-4586-a009-a8de99a6fd35 tempest-ProjectReaderTests-1169210101 None] Acquiring lock "cinder-a49377a8-c85b-4e9c-a30b-fc024261622b-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b5e2c904-7d54-4586-a009-a8de99a6fd35 tempest-ProjectReaderTests-1169210101 None] Lock "cinder-a49377a8-c85b-4e9c-a30b-fc024261622b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b5e2c904-7d54-4586-a009-a8de99a6fd35 tempest-ProjectReaderTests-1169210101 None] Acquiring lock "cinder-quobyte-a49377a8-c85b-4e9c-a30b-fc024261622b" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b5e2c904-7d54-4586-a009-a8de99a6fd35 tempest-ProjectReaderTests-1169210101 None] Lock "cinder-quobyte-a49377a8-c85b-4e9c-a30b-fc024261622b" acquired by "delete_volume" :: waited 0.029s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:46 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[00321051-ad83-4f21-836e-5ad162490479]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b5e2c904-7d54-4586-a009-a8de99a6fd35 tempest-ProjectReaderTests-1169210101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a49377a8-c85b-4e9c-a30b-fc024261622b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9b0d2861-b8c9-426b-a8ba-39a52f7dde69 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-426ef7e1-881d-4f6e-adb3-68b1571342e2-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9b0d2861-b8c9-426b-a8ba-39a52f7dde69 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-426ef7e1-881d-4f6e-adb3-68b1571342e2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9b0d2861-b8c9-426b-a8ba-39a52f7dde69 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-426ef7e1-881d-4f6e-adb3-68b1571342e2" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:46 devstack sudo[108876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a49377a8-c85b-4e9c-a30b-fc024261622b
Sep 28 18:30:46 devstack sudo[108876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9b0d2861-b8c9-426b-a8ba-39a52f7dde69 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-426ef7e1-881d-4f6e-adb3-68b1571342e2" acquired by "delete_volume" :: waited 0.021s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:46 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[089440cd-a6d4-4714-970b-ca7e64e10da2]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9b0d2861-b8c9-426b-a8ba-39a52f7dde69 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:46 devstack sudo[108878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2
Sep 28 18:30:46 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:46 devstack sudo[108876]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b5e2c904-7d54-4586-a009-a8de99a6fd35 tempest-ProjectReaderTests-1169210101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a49377a8-c85b-4e9c-a30b-fc024261622b" returned: 0 in 0.642s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b5e2c904-7d54-4586-a009-a8de99a6fd35 tempest-ProjectReaderTests-1169210101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a49377a8-c85b-4e9c-a30b-fc024261622b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:46 devstack sudo[108883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a49377a8-c85b-4e9c-a30b-fc024261622b
Sep 28 18:30:46 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:46 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9b0d2861-b8c9-426b-a8ba-39a52f7dde69 tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2" returned: 0 in 0.569s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9b0d2861-b8c9-426b-a8ba-39a52f7dde69 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:47 devstack sudo[108888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2
Sep 28 18:30:47 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:47 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b5e2c904-7d54-4586-a009-a8de99a6fd35 tempest-ProjectReaderTests-1169210101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-a49377a8-c85b-4e9c-a30b-fc024261622b" returned: 0 in 0.477s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:47 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b5e2c904-7d54-4586-a009-a8de99a6fd35 tempest-ProjectReaderTests-1169210101 None] Lock "cinder-quobyte-a49377a8-c85b-4e9c-a30b-fc024261622b" released by "delete_volume" :: held 1.184s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:47 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9b0d2861-b8c9-426b-a8ba-39a52f7dde69 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-426ef7e1-881d-4f6e-adb3-68b1571342e2" returned: 0 in 0.509s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:47 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9b0d2861-b8c9-426b-a8ba-39a52f7dde69 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-426ef7e1-881d-4f6e-adb3-68b1571342e2" released by "delete_volume" :: held 1.171s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:47 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-b5e2c904-7d54-4586-a009-a8de99a6fd35 tempest-ProjectReaderTests-1169210101 None] Created reservations ['e6dd6698-92f5-4451-aa84-cbd1a543146e', '22e6c7de-8ce1-4cb6-811f-8015a5949b51', '6ce4a138-35fa-4b45-80aa-b5572c476a0c', '4c85e2ad-9975-40d7-8321-746d043adcf4'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:30:47 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-9b0d2861-b8c9-426b-a8ba-39a52f7dde69 tempest-ProjectMemberTests-2016434849 None] Created reservations ['e3290441-b8e6-4b2f-bc47-cb7a282cf553', '19c7dcf0-2cec-4ec3-b266-f8c2e991cd34', 'e66aa495-62ba-487e-88f4-5c4587594d4e', '36a9d305-9382-48f2-837c-a923370d5f51'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:30:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b5e2c904-7d54-4586-a009-a8de99a6fd35 tempest-ProjectReaderTests-1169210101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b5e2c904-7d54-4586-a009-a8de99a6fd35 tempest-ProjectReaderTests-1169210101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:48 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b5e2c904-7d54-4586-a009-a8de99a6fd35 tempest-ProjectReaderTests-1169210101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:48 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-b5e2c904-7d54-4586-a009-a8de99a6fd35 tempest-ProjectReaderTests-1169210101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-b5e2c904-7d54-4586-a009-a8de99a6fd35 tempest-ProjectReaderTests-1169210101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b5e2c904-7d54-4586-a009-a8de99a6fd35 tempest-ProjectReaderTests-1169210101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:48 devstack sudo[108892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:30:48 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9b0d2861-b8c9-426b-a8ba-39a52f7dde69 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9b0d2861-b8c9-426b-a8ba-39a52f7dde69 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:48 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9b0d2861-b8c9-426b-a8ba-39a52f7dde69 tempest-ProjectMemberTests-2016434849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:48 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9b0d2861-b8c9-426b-a8ba-39a52f7dde69 tempest-ProjectMemberTests-2016434849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9b0d2861-b8c9-426b-a8ba-39a52f7dde69 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9b0d2861-b8c9-426b-a8ba-39a52f7dde69 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:48 devstack sudo[108894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:30:48 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:48 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b5e2c904-7d54-4586-a009-a8de99a6fd35 tempest-ProjectReaderTests-1169210101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.622s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:48 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-b5e2c904-7d54-4586-a009-a8de99a6fd35 tempest-ProjectReaderTests-1169210101 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:30:48 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-b5e2c904-7d54-4586-a009-a8de99a6fd35 tempest-ProjectReaderTests-1169210101 None] Deleted volume successfully.
Sep 28 18:30:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b5e2c904-7d54-4586-a009-a8de99a6fd35 tempest-ProjectReaderTests-1169210101 None] Lock "cinder-a49377a8-c85b-4e9c-a30b-fc024261622b-delete_volume" released by "delete_volume" :: held 2.777s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:48 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9b0d2861-b8c9-426b-a8ba-39a52f7dde69 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.681s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:48 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-9b0d2861-b8c9-426b-a8ba-39a52f7dde69 tempest-ProjectMemberTests-2016434849 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:30:48 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-9b0d2861-b8c9-426b-a8ba-39a52f7dde69 tempest-ProjectMemberTests-2016434849 None] Deleted volume successfully.
Sep 28 18:30:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-9b0d2861-b8c9-426b-a8ba-39a52f7dde69 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-426ef7e1-881d-4f6e-adb3-68b1571342e2-delete_volume" released by "delete_volume" :: held 2.641s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:49 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:30:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Flow 'volume_create_manager' (d7124ad7-3ef4-41e4-a72e-bd5b48084661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d9fcef8-afcd-4662-b5ee-c280f40b2025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d9fcef8-afcd-4662-b5ee-c280f40b2025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1957963084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb8e6288-0632-47c1-b2af-b4f3fcb2d73c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da056a4fd1e748f88f9289ddd0dce4d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:50Z,use_quota=True,user_id='f7bc483a2a324dc2b22adfac8347b91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa46c01d-d01b-464f-b25e-b4c832fcab6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa46c01d-d01b-464f-b25e-b4c832fcab6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34bbf359-c178-498e-87ee-5934c5491c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34bbf359-c178-498e-87ee-5934c5491c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb8e6288-0632-47c1-b2af-b4f3fcb2d73c', 'volume_name': 'volume-fb8e6288-0632-47c1-b2af-b4f3fcb2d73c', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b6bd53-ea22-4a21-91b9-853380e91d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b6bd53-ea22-4a21-91b9-853380e91d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:49 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02debc82-dfad-4fef-90ea-94cbe025b0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:49 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Volume fb8e6288-0632-47c1-b2af-b4f3fcb2d73c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb8e6288-0632-47c1-b2af-b4f3fcb2d73c', 'volume_size': 1}
Sep 28 18:30:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1957963084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb8e6288-0632-47c1-b2af-b4f3fcb2d73c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da056a4fd1e748f88f9289ddd0dce4d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:50Z,use_quota=True,user_id='f7bc483a2a324dc2b22adfac8347b91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:30:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Creating volume fb8e6288-0632-47c1-b2af-b4f3fcb2d73c {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:30:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:30:49 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:30:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fb8e6288-0632-47c1-b2af-b4f3fcb2d73c 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:50 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:30:50 devstack sudo[108898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fb8e6288-0632-47c1-b2af-b4f3fcb2d73c 1073741824
Sep 28 18:30:50 devstack sudo[108898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:50 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Flow 'volume_create_manager' (8a656ed6-fb96-4c5e-96a7-9b273a3745a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:50 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83020b3-c296-4804-8102-5470d4507921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:50 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83020b3-c296-4804-8102-5470d4507921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-337445676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=175e94ad-811b-4d25-b23f-0dd6c6878e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7141bfada145467eb777f5e9601f614e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:50Z,use_quota=True,user_id='19ef54da5952457abebbe56a45760423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:50 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c8615a3-0d43-4b4b-af6c-9682784e6525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:50 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c8615a3-0d43-4b4b-af6c-9682784e6525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:50 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9946f2a-745c-4962-b6c9-1d1ad597e1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:50 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9946f2a-745c-4962-b6c9-1d1ad597e1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '175e94ad-811b-4d25-b23f-0dd6c6878e9c', 'volume_name': 'volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:50 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec19942-6033-4008-83b5-51c766941755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:50 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec19942-6033-4008-83b5-51c766941755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:50 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b944c6-f138-4100-a89e-71aadb7b0e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:50 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Volume 175e94ad-811b-4d25-b23f-0dd6c6878e9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c', 'volume_size': 1}
Sep 28 18:30:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:50 devstack sudo[108898]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fb8e6288-0632-47c1-b2af-b4f3fcb2d73c 1073741824" returned: 0 in 0.699s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fb8e6288-0632-47c1-b2af-b4f3fcb2d73c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:50 devstack sudo[108904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fb8e6288-0632-47c1-b2af-b4f3fcb2d73c
Sep 28 18:30:50 devstack sudo[108904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:50 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-45e0e63e-31df-49d9-b557-8e88bd4d7463 tempest-ProjectAdminTests-428987659 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.122184753418, 'free_capacity_gb': 1775.122184753418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87046) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 28 18:30:51 devstack sudo[108904]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fb8e6288-0632-47c1-b2af-b4f3fcb2d73c" returned: 0 in 0.329s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:30:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.898s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-337445676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=175e94ad-811b-4d25-b23f-0dd6c6878e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7141bfada145467eb777f5e9601f614e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:50Z,use_quota=True,user_id='19ef54da5952457abebbe56a45760423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:30:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Creating volume 175e94ad-811b-4d25-b23f-0dd6c6878e9c {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:30:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:30:51 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:30:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02debc82-dfad-4fef-90ea-94cbe025b0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb8e6288-0632-47c1-b2af-b4f3fcb2d73c', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb62a23-16f9-407e-a8aa-37314ad18f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:51 devstack sudo[108907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c 1073741824
Sep 28 18:30:51 devstack sudo[108907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:51 devstack sudo[108907]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c 1073741824" returned: 0 in 0.520s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:51 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Volume volume-fb8e6288-0632-47c1-b2af-b4f3fcb2d73c (fb8e6288-0632-47c1-b2af-b4f3fcb2d73c): created successfully
Sep 28 18:30:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb62a23-16f9-407e-a8aa-37314ad18f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Flow 'volume_create_manager' (d7124ad7-3ef4-41e4-a72e-bd5b48084661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:52 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-a19b5464-1c8a-42aa-b681-4a1b7e424473 tempest-ProjectReaderTests-1169210101 None] Created volume successfully.
Sep 28 18:30:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:54 devstack sudo[108914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c
Sep 28 18:30:54 devstack sudo[108914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:54 devstack sudo[108914]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c" returned: 0 in 0.287s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:54 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] <== create_volume: return (3281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:30:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.286s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:55 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b944c6-f138-4100-a89e-71aadb7b0e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa590df-152f-4767-84c0-21e713794479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8980a6f4-25b9-4131-87be-1d70d53c492e tempest-ProjectReaderTests-1169210101 None] Acquiring lock "cinder-fb8e6288-0632-47c1-b2af-b4f3fcb2d73c-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:56 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Volume volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c (175e94ad-811b-4d25-b23f-0dd6c6878e9c): created successfully
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa590df-152f-4767-84c0-21e713794479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Flow 'volume_create_manager' (8a656ed6-fb96-4c5e-96a7-9b273a3745a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8980a6f4-25b9-4131-87be-1d70d53c492e tempest-ProjectReaderTests-1169210101 None] Lock "cinder-fb8e6288-0632-47c1-b2af-b4f3fcb2d73c-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:56 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-41843514-d8ee-4366-b6d9-8db876a03738 tempest-ProjectMemberTests-2016434849 None] Created volume successfully.
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8980a6f4-25b9-4131-87be-1d70d53c492e tempest-ProjectReaderTests-1169210101 None] Acquiring lock "cinder-quobyte-fb8e6288-0632-47c1-b2af-b4f3fcb2d73c" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8980a6f4-25b9-4131-87be-1d70d53c492e tempest-ProjectReaderTests-1169210101 None] Lock "cinder-quobyte-fb8e6288-0632-47c1-b2af-b4f3fcb2d73c" acquired by "delete_volume" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1111f90-9280-4f2c-b585-af9afc7f6ab5]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8980a6f4-25b9-4131-87be-1d70d53c492e tempest-ProjectReaderTests-1169210101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fb8e6288-0632-47c1-b2af-b4f3fcb2d73c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:56 devstack sudo[108917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fb8e6288-0632-47c1-b2af-b4f3fcb2d73c
Sep 28 18:30:56 devstack sudo[108917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6df9aaba-0a8a-4dd9-b48a-55878c1dcfc7 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6df9aaba-0a8a-4dd9-b48a-55878c1dcfc7 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Flow 'volume_create_manager' (2420b066-6b44-405b-be4d-a5246e34c280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a509883-e0f2-42f0-bb36-f4dcae736b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-6df9aaba-0a8a-4dd9-b48a-55878c1dcfc7 tempest-ProjectMemberTests-2016434849 None] Creating offline snapshot cd290088-27a4-4f9f-b44b-b7dd9290a9c1 of volume 175e94ad-811b-4d25-b23f-0dd6c6878e9c {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a509883-e0f2-42f0-bb36-f4dcae736b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2141106796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58a2f657b6a4d34bb92576f5a009201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:57Z,use_quota=True,user_id='92fd6b7c354b4eed9531628d99feda72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:56 devstack sudo[108917]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (615e9e2c-3abe-410c-ac76-85b9e02808a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (615e9e2c-3abe-410c-ac76-85b9e02808a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4901fcf1-6298-4518-9b82-1bf7bf02b55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4901fcf1-6298-4518-9b82-1bf7bf02b55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b', 'volume_name': 'volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a157506d-e47b-4985-a22f-10019cb32bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a157506d-e47b-4985-a22f-10019cb32bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06fec23c-5cf9-48d0-8bb7-7f9227831cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:56 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Volume d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b', 'volume_size': 1}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ccb0f6-35fa-4135-a0e4-ee49920c0a3c]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6df9aaba-0a8a-4dd9-b48a-55878c1dcfc7 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8980a6f4-25b9-4131-87be-1d70d53c492e tempest-ProjectReaderTests-1169210101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fb8e6288-0632-47c1-b2af-b4f3fcb2d73c" returned: 0 in 0.661s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8980a6f4-25b9-4131-87be-1d70d53c492e tempest-ProjectReaderTests-1169210101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fb8e6288-0632-47c1-b2af-b4f3fcb2d73c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:56 devstack sudo[108923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fb8e6288-0632-47c1-b2af-b4f3fcb2d73c
Sep 28 18:30:56 devstack sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:57 devstack sudo[108922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c
Sep 28 18:30:57 devstack sudo[108922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:57 devstack sudo[108923]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8980a6f4-25b9-4131-87be-1d70d53c492e tempest-ProjectReaderTests-1169210101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-fb8e6288-0632-47c1-b2af-b4f3fcb2d73c" returned: 0 in 0.366s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8980a6f4-25b9-4131-87be-1d70d53c492e tempest-ProjectReaderTests-1169210101 None] Lock "cinder-quobyte-fb8e6288-0632-47c1-b2af-b4f3fcb2d73c" released by "delete_volume" :: held 1.096s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:57 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-8980a6f4-25b9-4131-87be-1d70d53c492e tempest-ProjectReaderTests-1169210101 None] Created reservations ['3aede941-bb55-4450-9672-3447ea857c3f', '794aef8c-4bd5-4604-b46b-94e39e03bd80', 'a56e91d0-0316-44fb-a359-e10438508c81', 'a22b235c-aff4-4dff-b9c6-e7753c985e1e'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:30:57 devstack sudo[108922]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6df9aaba-0a8a-4dd9-b48a-55878c1dcfc7 tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c" returned: 0 in 0.504s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6df9aaba-0a8a-4dd9-b48a-55878c1dcfc7 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.cd290088-27a4-4f9f-b44b-b7dd9290a9c1 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:57 devstack sudo[108930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.cd290088-27a4-4f9f-b44b-b7dd9290a9c1 1G
Sep 28 18:30:57 devstack sudo[108930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8980a6f4-25b9-4131-87be-1d70d53c492e tempest-ProjectReaderTests-1169210101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8980a6f4-25b9-4131-87be-1d70d53c492e tempest-ProjectReaderTests-1169210101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:57 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8980a6f4-25b9-4131-87be-1d70d53c492e tempest-ProjectReaderTests-1169210101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:57 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8980a6f4-25b9-4131-87be-1d70d53c492e tempest-ProjectReaderTests-1169210101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8980a6f4-25b9-4131-87be-1d70d53c492e tempest-ProjectReaderTests-1169210101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8980a6f4-25b9-4131-87be-1d70d53c492e tempest-ProjectReaderTests-1169210101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:57 devstack sudo[108932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:30:57 devstack sudo[108932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:57 devstack sudo[108932]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8980a6f4-25b9-4131-87be-1d70d53c492e tempest-ProjectReaderTests-1169210101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.348s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:57 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-8980a6f4-25b9-4131-87be-1d70d53c492e tempest-ProjectReaderTests-1169210101 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:30:57 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-8980a6f4-25b9-4131-87be-1d70d53c492e tempest-ProjectReaderTests-1169210101 None] Deleted volume successfully.
Sep 28 18:30:57 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8980a6f4-25b9-4131-87be-1d70d53c492e tempest-ProjectReaderTests-1169210101 None] Lock "cinder-fb8e6288-0632-47c1-b2af-b4f3fcb2d73c-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:30:57 devstack sudo[108930]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6df9aaba-0a8a-4dd9-b48a-55878c1dcfc7 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.cd290088-27a4-4f9f-b44b-b7dd9290a9c1 1G" returned: 0 in 0.588s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6df9aaba-0a8a-4dd9-b48a-55878c1dcfc7 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.cd290088-27a4-4f9f-b44b-b7dd9290a9c1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:58 devstack sudo[108939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.cd290088-27a4-4f9f-b44b-b7dd9290a9c1
Sep 28 18:30:58 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:58 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6df9aaba-0a8a-4dd9-b48a-55878c1dcfc7 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.cd290088-27a4-4f9f-b44b-b7dd9290a9c1" returned: 0 in 0.377s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:58 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-6df9aaba-0a8a-4dd9-b48a-55878c1dcfc7 tempest-ProjectMemberTests-2016434849 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.cd290088-27a4-4f9f-b44b-b7dd9290a9c1 is being set with open permissions: ugo+rw
Sep 28 18:30:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6df9aaba-0a8a-4dd9-b48a-55878c1dcfc7 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.cd290088-27a4-4f9f-b44b-b7dd9290a9c1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:58 devstack sudo[108944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.cd290088-27a4-4f9f-b44b-b7dd9290a9c1
Sep 28 18:30:58 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:58 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6df9aaba-0a8a-4dd9-b48a-55878c1dcfc7 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.cd290088-27a4-4f9f-b44b-b7dd9290a9c1" returned: 0 in 0.395s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6df9aaba-0a8a-4dd9-b48a-55878c1dcfc7 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:58 devstack sudo[108947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.info
Sep 28 18:30:58 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:58 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:30:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Flow 'volume_create_manager' (9432e9c8-d833-47af-9bc0-b4a0cd5965f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:30:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a681ca39-1c93-406c-89f2-9ee65451076f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a681ca39-1c93-406c-89f2-9ee65451076f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1951960743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44283978-d5bf-4c73-ba57-5e269f9d5b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da056a4fd1e748f88f9289ddd0dce4d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:59Z,use_quota=True,user_id='f7bc483a2a324dc2b22adfac8347b91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:58 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd477016-c33e-4a4e-9c3a-b85793805060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd477016-c33e-4a4e-9c3a-b85793805060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3edd1d57-9258-4192-957e-3263f919fe6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3edd1d57-9258-4192-957e-3263f919fe6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44283978-d5bf-4c73-ba57-5e269f9d5b84', 'volume_name': 'volume-44283978-d5bf-4c73-ba57-5e269f9d5b84', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1add601-91be-423e-98f6-7b9230b5c79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1add601-91be-423e-98f6-7b9230b5c79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9e45e5-9ebd-4d25-b3b1-3bd933628505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:30:59 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Volume 44283978-d5bf-4c73-ba57-5e269f9d5b84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44283978-d5bf-4c73-ba57-5e269f9d5b84', 'volume_size': 1}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:59 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6df9aaba-0a8a-4dd9-b48a-55878c1dcfc7 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.info" returned: 0 in 0.344s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:59 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-6df9aaba-0a8a-4dd9-b48a-55878c1dcfc7 tempest-ProjectMemberTests-2016434849 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.info is being set with open permissions: ugo+rw
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6df9aaba-0a8a-4dd9-b48a-55878c1dcfc7 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:59 devstack sudo[108950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.info
Sep 28 18:30:59 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:59 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6df9aaba-0a8a-4dd9-b48a-55878c1dcfc7 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.info" returned: 0 in 0.282s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6df9aaba-0a8a-4dd9-b48a-55878c1dcfc7 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.698s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.560s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2141106796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58a2f657b6a4d34bb92576f5a009201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:57Z,use_quota=True,user_id='92fd6b7c354b4eed9531628d99feda72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Creating volume d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:30:59 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:30:59 devstack sudo[108953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b 1073741824
Sep 28 18:30:59 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:30:59 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-6df9aaba-0a8a-4dd9-b48a-55878c1dcfc7 tempest-ProjectMemberTests-2016434849 None] Create snapshot completed successfully
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c7a6231f-1901-489d-933c-1299ee6ef4cf tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-cd290088-27a4-4f9f-b44b-b7dd9290a9c1-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c7a6231f-1901-489d-933c-1299ee6ef4cf tempest-ProjectMemberTests-2016434849 None] Lock "cinder-cd290088-27a4-4f9f-b44b-b7dd9290a9c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c7a6231f-1901-489d-933c-1299ee6ef4cf tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-175e94ad-811b-4d25-b23f-0dd6c6878e9c" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c7a6231f-1901-489d-933c-1299ee6ef4cf tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-175e94ad-811b-4d25-b23f-0dd6c6878e9c" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c7a6231f-1901-489d-933c-1299ee6ef4cf tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-cd290088-27a4-4f9f-b44b-b7dd9290a9c1" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c7a6231f-1901-489d-933c-1299ee6ef4cf tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-cd290088-27a4-4f9f-b44b-b7dd9290a9c1" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:30:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-c7a6231f-1901-489d-933c-1299ee6ef4cf tempest-ProjectMemberTests-2016434849 None] Deleting offline snapshot cd290088-27a4-4f9f-b44b-b7dd9290a9c1 of volume 175e94ad-811b-4d25-b23f-0dd6c6878e9c {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-c7a6231f-1901-489d-933c-1299ee6ef4cf tempest-ProjectMemberTests-2016434849 None] snapshot_file for this snap is: volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.cd290088-27a4-4f9f-b44b-b7dd9290a9c1 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[779be1d5-b346-418f-9027-03809a72d01d]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c7a6231f-1901-489d-933c-1299ee6ef4cf tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.cd290088-27a4-4f9f-b44b-b7dd9290a9c1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:00 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b 1073741824" returned: 0 in 0.652s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:00 devstack sudo[108959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.cd290088-27a4-4f9f-b44b-b7dd9290a9c1
Sep 28 18:31:00 devstack sudo[108959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:00 devstack sudo[108960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b
Sep 28 18:31:00 devstack sudo[108960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:00 devstack sudo[108960]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b" returned: 0 in 0.321s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.463s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1951960743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44283978-d5bf-4c73-ba57-5e269f9d5b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da056a4fd1e748f88f9289ddd0dce4d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:59Z,use_quota=True,user_id='f7bc483a2a324dc2b22adfac8347b91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Creating volume 44283978-d5bf-4c73-ba57-5e269f9d5b84 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:31:00 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-44283978-d5bf-4c73-ba57-5e269f9d5b84 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:00 devstack sudo[108959]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c7a6231f-1901-489d-933c-1299ee6ef4cf tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.cd290088-27a4-4f9f-b44b-b7dd9290a9c1" returned: 0 in 0.506s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-c7a6231f-1901-489d-933c-1299ee6ef4cf tempest-ProjectMemberTests-2016434849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:31:00 devstack sudo[108967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-44283978-d5bf-4c73-ba57-5e269f9d5b84 1073741824
Sep 28 18:31:00 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06fec23c-5cf9-48d0-8bb7-7f9227831cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0606aca-962c-430d-961b-7860c7810817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a47dd9-3328-4fe7-a69b-a3f683b125c6]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c7a6231f-1901-489d-933c-1299ee6ef4cf tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:00 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Volume volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b (d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b): created successfully
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0606aca-962c-430d-961b-7860c7810817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:00 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Flow 'volume_create_manager' (2420b066-6b44-405b-be4d-a5246e34c280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:00 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-bc6fb490-9583-4ce5-ada2-2abd5bb66765 tempest-SnapshotDependencyTests-400063745 None] Created volume successfully.
Sep 28 18:31:00 devstack sudo[108969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c
Sep 28 18:31:00 devstack sudo[108969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Flow 'volume_create_manager' (30010743-5c67-4bbf-88ea-a67f0fa6c6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950d1cbe-03b2-4f6f-9f6d-b716a7964bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950d1cbe-03b2-4f6f-9f6d-b716a7964bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-749987484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765c6e99-e315-4d85-9532-2350c5de5717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa1f17ecf644a9b93b4b4d10bad8593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:01Z,use_quota=True,user_id='215f54ccefe14730a0310f724f3df258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e141072d-f6b5-48eb-b28a-83cd0e450826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e141072d-f6b5-48eb-b28a-83cd0e450826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aeb0716-1d8b-4a46-a6e2-0835c5767e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aeb0716-1d8b-4a46-a6e2-0835c5767e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '765c6e99-e315-4d85-9532-2350c5de5717', 'volume_name': 'volume-765c6e99-e315-4d85-9532-2350c5de5717', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffd6237-98dc-46a0-bbae-3ff64bac9d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffd6237-98dc-46a0-bbae-3ff64bac9d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a791f0-ee65-4f0a-8c6d-983277c61640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:01 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Volume 765c6e99-e315-4d85-9532-2350c5de5717: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-765c6e99-e315-4d85-9532-2350c5de5717', 'volume_size': 1}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:01 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-44283978-d5bf-4c73-ba57-5e269f9d5b84 1073741824" returned: 0 in 0.693s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-44283978-d5bf-4c73-ba57-5e269f9d5b84 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:01 devstack sudo[108969]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c7a6231f-1901-489d-933c-1299ee6ef4cf tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c" returned: 0 in 0.662s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c7a6231f-1901-489d-933c-1299ee6ef4cf tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.cd290088-27a4-4f9f-b44b-b7dd9290a9c1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:01 devstack sudo[108977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-44283978-d5bf-4c73-ba57-5e269f9d5b84
Sep 28 18:31:01 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:01 devstack sudo[108978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.cd290088-27a4-4f9f-b44b-b7dd9290a9c1
Sep 28 18:31:01 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-076d4180-0a2c-46f4-97c6-8e73744c3f3f tempest-SnapshotDependencyTests-400063745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:01 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-44283978-d5bf-4c73-ba57-5e269f9d5b84" returned: 0 in 0.346s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.478s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-749987484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765c6e99-e315-4d85-9532-2350c5de5717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa1f17ecf644a9b93b4b4d10bad8593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:01Z,use_quota=True,user_id='215f54ccefe14730a0310f724f3df258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Creating volume 765c6e99-e315-4d85-9532-2350c5de5717 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:31:01 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:01 devstack sudo[108986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717 1073741824
Sep 28 18:31:01 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9e45e5-9ebd-4d25-b3b1-3bd933628505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44283978-d5bf-4c73-ba57-5e269f9d5b84', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84e86c9-8d80-4869-9d21-2cd31d0f82fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:01 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Volume volume-44283978-d5bf-4c73-ba57-5e269f9d5b84 (44283978-d5bf-4c73-ba57-5e269f9d5b84): created successfully
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84e86c9-8d80-4869-9d21-2cd31d0f82fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Flow 'volume_create_manager' (9432e9c8-d833-47af-9bc0-b4a0cd5965f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:01 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-cca813df-5ce8-43bc-9653-907acadd553d tempest-ProjectReaderTests-1169210101 None] Created volume successfully.
Sep 28 18:31:01 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c7a6231f-1901-489d-933c-1299ee6ef4cf tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.cd290088-27a4-4f9f-b44b-b7dd9290a9c1" returned: 0 in 0.488s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c7a6231f-1901-489d-933c-1299ee6ef4cf tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.cd290088-27a4-4f9f-b44b-b7dd9290a9c1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:01 devstack sudo[108988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.cd290088-27a4-4f9f-b44b-b7dd9290a9c1
Sep 28 18:31:01 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:02 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-c7a6231f-1901-489d-933c-1299ee6ef4cf tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c.cd290088-27a4-4f9f-b44b-b7dd9290a9c1" returned: 0 in 0.328s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c7a6231f-1901-489d-933c-1299ee6ef4cf tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-cd290088-27a4-4f9f-b44b-b7dd9290a9c1" released by "_delete_snapshot" :: held 2.170s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c7a6231f-1901-489d-933c-1299ee6ef4cf tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-175e94ad-811b-4d25-b23f-0dd6c6878e9c" released by "delete_snapshot" :: held 2.212s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f9845ddc-5121-4da2-a5e8-f56d653bc932 tempest-ProjectReaderTests-1169210101 None] Acquiring lock "cinder-44283978-d5bf-4c73-ba57-5e269f9d5b84-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-c7a6231f-1901-489d-933c-1299ee6ef4cf tempest-ProjectMemberTests-2016434849 None] Created reservations ['2e21e20d-59fe-4645-af79-546647793fd3', 'b8b771c4-1112-47a7-bc2e-cf74604f0ba6', '01668fbd-0f59-4b12-9242-5b8818af3591', '4fcf3df6-1400-4343-abae-35d5a9a5b55d'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f9845ddc-5121-4da2-a5e8-f56d653bc932 tempest-ProjectReaderTests-1169210101 None] Lock "cinder-44283978-d5bf-4c73-ba57-5e269f9d5b84-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:02 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717 1073741824" returned: 0 in 0.713s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f9845ddc-5121-4da2-a5e8-f56d653bc932 tempest-ProjectReaderTests-1169210101 None] Acquiring lock "cinder-quobyte-44283978-d5bf-4c73-ba57-5e269f9d5b84" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f9845ddc-5121-4da2-a5e8-f56d653bc932 tempest-ProjectReaderTests-1169210101 None] Lock "cinder-quobyte-44283978-d5bf-4c73-ba57-5e269f9d5b84" acquired by "delete_volume" :: waited 0.040s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:02 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-c7a6231f-1901-489d-933c-1299ee6ef4cf tempest-ProjectMemberTests-2016434849 None] Delete snapshot completed successfully.
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-c7a6231f-1901-489d-933c-1299ee6ef4cf tempest-ProjectMemberTests-2016434849 None] Lock "cinder-cd290088-27a4-4f9f-b44b-b7dd9290a9c1-delete_snapshot" released by "delete_snapshot" :: held 2.537s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d896f1-f19e-49ba-9b6f-6d7b4bc6a7d7]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f9845ddc-5121-4da2-a5e8-f56d653bc932 tempest-ProjectReaderTests-1169210101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-44283978-d5bf-4c73-ba57-5e269f9d5b84 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:02 devstack sudo[109001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717
Sep 28 18:31:02 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:02 devstack sudo[109002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-44283978-d5bf-4c73-ba57-5e269f9d5b84
Sep 28 18:31:02 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:02 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717" returned: 0 in 0.315s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-076d4180-0a2c-46f4-97c6-8e73744c3f3f tempest-SnapshotDependencyTests-400063745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.356s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a791f0-ee65-4f0a-8c6d-983277c61640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-765c6e99-e315-4d85-9532-2350c5de5717', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc286857-eb1b-4752-a7a2-489c9f8d769a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-076d4180-0a2c-46f4-97c6-8e73744c3f3f tempest-SnapshotDependencyTests-400063745 None] Creating offline snapshot 9e4087b3-7d9a-4506-8ac7-a890d5b6f318 of volume d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:31:02 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Volume volume-765c6e99-e315-4d85-9532-2350c5de5717 (765c6e99-e315-4d85-9532-2350c5de5717): created successfully
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc286857-eb1b-4752-a7a2-489c9f8d769a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Flow 'volume_create_manager' (30010743-5c67-4bbf-88ea-a67f0fa6c6b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c373ff4-f93a-4683-a1ba-7a1bf17862d2]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-076d4180-0a2c-46f4-97c6-8e73744c3f3f tempest-SnapshotDependencyTests-400063745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:02 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-069b3e04-b554-4734-9fbe-290d4e4c6c30 tempest-ProjectReaderTests-257558821 None] Created volume successfully.
Sep 28 18:31:02 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f9845ddc-5121-4da2-a5e8-f56d653bc932 tempest-ProjectReaderTests-1169210101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-44283978-d5bf-4c73-ba57-5e269f9d5b84" returned: 0 in 0.496s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f9845ddc-5121-4da2-a5e8-f56d653bc932 tempest-ProjectReaderTests-1169210101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-44283978-d5bf-4c73-ba57-5e269f9d5b84 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:02 devstack sudo[109007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b
Sep 28 18:31:02 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:02 devstack sudo[109010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-44283978-d5bf-4c73-ba57-5e269f9d5b84
Sep 28 18:31:02 devstack sudo[109010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8e8b9f3a-8dcd-42ec-a6e4-2de4a12f0414 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-175e94ad-811b-4d25-b23f-0dd6c6878e9c-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8e8b9f3a-8dcd-42ec-a6e4-2de4a12f0414 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-175e94ad-811b-4d25-b23f-0dd6c6878e9c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8e8b9f3a-8dcd-42ec-a6e4-2de4a12f0414 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-175e94ad-811b-4d25-b23f-0dd6c6878e9c" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8e8b9f3a-8dcd-42ec-a6e4-2de4a12f0414 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-175e94ad-811b-4d25-b23f-0dd6c6878e9c" acquired by "delete_volume" :: waited 0.027s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:03 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-076d4180-0a2c-46f4-97c6-8e73744c3f3f tempest-SnapshotDependencyTests-400063745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b" returned: 0 in 0.633s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:03 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab135d4-a7fd-43e3-a914-40bd5eebd440]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:03 devstack sudo[109010]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-076d4180-0a2c-46f4-97c6-8e73744c3f3f tempest-SnapshotDependencyTests-400063745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8e8b9f3a-8dcd-42ec-a6e4-2de4a12f0414 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:03 devstack sudo[109018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318 1G
Sep 28 18:31:03 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-87412149-a3de-44bc-b5bb-6ac1569bfb2a tempest-ProjectReaderTests-257558821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f9845ddc-5121-4da2-a5e8-f56d653bc932 tempest-ProjectReaderTests-1169210101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-44283978-d5bf-4c73-ba57-5e269f9d5b84" returned: 0 in 0.570s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f9845ddc-5121-4da2-a5e8-f56d653bc932 tempest-ProjectReaderTests-1169210101 None] Lock "cinder-quobyte-44283978-d5bf-4c73-ba57-5e269f9d5b84" released by "delete_volume" :: held 1.158s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:03 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-f9845ddc-5121-4da2-a5e8-f56d653bc932 tempest-ProjectReaderTests-1169210101 None] Created reservations ['56be3594-5365-4c91-9bf0-fabcc272aa12', '9c4d0c02-72b9-4c35-8b66-6b0879b09745', '8d5534af-328a-4908-ac99-e151fd9c54b6', '22b94c42-d101-4ff2-986f-c084ae74e7ee'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:03 devstack sudo[109019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c
Sep 28 18:31:03 devstack sudo[109019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f9845ddc-5121-4da2-a5e8-f56d653bc932 tempest-ProjectReaderTests-1169210101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f9845ddc-5121-4da2-a5e8-f56d653bc932 tempest-ProjectReaderTests-1169210101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:03 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f9845ddc-5121-4da2-a5e8-f56d653bc932 tempest-ProjectReaderTests-1169210101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:03 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f9845ddc-5121-4da2-a5e8-f56d653bc932 tempest-ProjectReaderTests-1169210101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f9845ddc-5121-4da2-a5e8-f56d653bc932 tempest-ProjectReaderTests-1169210101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f9845ddc-5121-4da2-a5e8-f56d653bc932 tempest-ProjectReaderTests-1169210101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:03 devstack sudo[109024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:31:03 devstack sudo[109024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:03 devstack sudo[109019]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8e8b9f3a-8dcd-42ec-a6e4-2de4a12f0414 tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c" returned: 0 in 0.464s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8e8b9f3a-8dcd-42ec-a6e4-2de4a12f0414 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:04 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:04 devstack sudo[109031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c
Sep 28 18:31:04 devstack sudo[109031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-076d4180-0a2c-46f4-97c6-8e73744c3f3f tempest-SnapshotDependencyTests-400063745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318 1G" returned: 0 in 0.517s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-076d4180-0a2c-46f4-97c6-8e73744c3f3f tempest-SnapshotDependencyTests-400063745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:04 devstack sudo[109033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318
Sep 28 18:31:04 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:04 devstack sudo[109024]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f9845ddc-5121-4da2-a5e8-f56d653bc932 tempest-ProjectReaderTests-1169210101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.372s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:04 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-f9845ddc-5121-4da2-a5e8-f56d653bc932 tempest-ProjectReaderTests-1169210101 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:31:04 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-f9845ddc-5121-4da2-a5e8-f56d653bc932 tempest-ProjectReaderTests-1169210101 None] Deleted volume successfully.
Sep 28 18:31:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f9845ddc-5121-4da2-a5e8-f56d653bc932 tempest-ProjectReaderTests-1169210101 None] Lock "cinder-44283978-d5bf-4c73-ba57-5e269f9d5b84-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:04 devstack sudo[109031]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8e8b9f3a-8dcd-42ec-a6e4-2de4a12f0414 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-175e94ad-811b-4d25-b23f-0dd6c6878e9c" returned: 0 in 0.351s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8e8b9f3a-8dcd-42ec-a6e4-2de4a12f0414 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-175e94ad-811b-4d25-b23f-0dd6c6878e9c" released by "delete_volume" :: held 0.959s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:04 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-076d4180-0a2c-46f4-97c6-8e73744c3f3f tempest-SnapshotDependencyTests-400063745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318" returned: 0 in 0.375s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:04 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-076d4180-0a2c-46f4-97c6-8e73744c3f3f tempest-SnapshotDependencyTests-400063745 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318 is being set with open permissions: ugo+rw
Sep 28 18:31:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-076d4180-0a2c-46f4-97c6-8e73744c3f3f tempest-SnapshotDependencyTests-400063745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:04 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-8e8b9f3a-8dcd-42ec-a6e4-2de4a12f0414 tempest-ProjectMemberTests-2016434849 None] Created reservations ['e300e006-5689-4fae-8497-cd36d05a39dc', '6868063c-106c-4d98-a2da-e83eae3c5735', 'bb295684-4915-47d6-951c-1404bd97e38b', '1dc7d5bc-e886-4f1a-b686-2c2a57e85597'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:04 devstack sudo[109040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318
Sep 28 18:31:04 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8e8b9f3a-8dcd-42ec-a6e4-2de4a12f0414 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8e8b9f3a-8dcd-42ec-a6e4-2de4a12f0414 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:04 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8e8b9f3a-8dcd-42ec-a6e4-2de4a12f0414 tempest-ProjectMemberTests-2016434849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:04 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-8e8b9f3a-8dcd-42ec-a6e4-2de4a12f0414 tempest-ProjectMemberTests-2016434849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8e8b9f3a-8dcd-42ec-a6e4-2de4a12f0414 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8e8b9f3a-8dcd-42ec-a6e4-2de4a12f0414 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:04 devstack sudo[109042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:31:04 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:04 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-076d4180-0a2c-46f4-97c6-8e73744c3f3f tempest-SnapshotDependencyTests-400063745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318" returned: 0 in 0.379s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:04 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8e8b9f3a-8dcd-42ec-a6e4-2de4a12f0414 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.283s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:04 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-8e8b9f3a-8dcd-42ec-a6e4-2de4a12f0414 tempest-ProjectMemberTests-2016434849 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:31:04 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-8e8b9f3a-8dcd-42ec-a6e4-2de4a12f0414 tempest-ProjectMemberTests-2016434849 None] Deleted volume successfully.
Sep 28 18:31:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-076d4180-0a2c-46f4-97c6-8e73744c3f3f tempest-SnapshotDependencyTests-400063745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:04 devstack sudo[109046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.info
Sep 28 18:31:04 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8e8b9f3a-8dcd-42ec-a6e4-2de4a12f0414 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-175e94ad-811b-4d25-b23f-0dd6c6878e9c-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:05 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-076d4180-0a2c-46f4-97c6-8e73744c3f3f tempest-SnapshotDependencyTests-400063745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.info" returned: 0 in 0.328s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:05 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-076d4180-0a2c-46f4-97c6-8e73744c3f3f tempest-SnapshotDependencyTests-400063745 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.info is being set with open permissions: ugo+rw
Sep 28 18:31:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-076d4180-0a2c-46f4-97c6-8e73744c3f3f tempest-SnapshotDependencyTests-400063745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:05 devstack sudo[109049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.info
Sep 28 18:31:05 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:05 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-076d4180-0a2c-46f4-97c6-8e73744c3f3f tempest-SnapshotDependencyTests-400063745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.info" returned: 0 in 0.325s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-076d4180-0a2c-46f4-97c6-8e73744c3f3f tempest-SnapshotDependencyTests-400063745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.732s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-87412149-a3de-44bc-b5bb-6ac1569bfb2a tempest-ProjectReaderTests-257558821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.987s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-87412149-a3de-44bc-b5bb-6ac1569bfb2a tempest-ProjectReaderTests-257558821 None] Creating offline snapshot 9140b9a7-9382-4ff6-ad64-04c9a69a6dff of volume 765c6e99-e315-4d85-9532-2350c5de5717 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:31:05 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-076d4180-0a2c-46f4-97c6-8e73744c3f3f tempest-SnapshotDependencyTests-400063745 None] Create snapshot completed successfully
Sep 28 18:31:05 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77829a4-6d1a-47e5-beb5-fd4472a52f78]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87412149-a3de-44bc-b5bb-6ac1569bfb2a tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:05 devstack sudo[109052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717
Sep 28 18:31:05 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:06 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:31:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Flow 'volume_create_manager' (c693179e-ebe3-4d47-ab4f-7a16927b5495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ead22f23-4a4f-4594-800e-cf2d399fa99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ead22f23-4a4f-4594-800e-cf2d399fa99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1088136289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af306f5d-171e-4dfd-93db-fb5412c4fde4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7141bfada145467eb777f5e9601f614e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:06Z,use_quota=True,user_id='19ef54da5952457abebbe56a45760423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb91c02-23d6-4388-9d88-4689927506cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:06 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb91c02-23d6-4388-9d88-4689927506cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c3da5e-173f-429f-9892-6dca283e8a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c3da5e-173f-429f-9892-6dca283e8a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af306f5d-171e-4dfd-93db-fb5412c4fde4', 'volume_name': 'volume-af306f5d-171e-4dfd-93db-fb5412c4fde4', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d767f3d-d404-4f07-aef7-2b3453af2773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d767f3d-d404-4f07-aef7-2b3453af2773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb401ded-0104-44ad-a7e5-8dc258cd5144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:06 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Volume af306f5d-171e-4dfd-93db-fb5412c4fde4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af306f5d-171e-4dfd-93db-fb5412c4fde4', 'volume_size': 1}
Sep 28 18:31:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87412149-a3de-44bc-b5bb-6ac1569bfb2a tempest-ProjectReaderTests-257558821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717" returned: 0 in 0.525s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87412149-a3de-44bc-b5bb-6ac1569bfb2a tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.9140b9a7-9382-4ff6-ad64-04c9a69a6dff 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:06 devstack sudo[109057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.9140b9a7-9382-4ff6-ad64-04c9a69a6dff 1G
Sep 28 18:31:06 devstack sudo[109057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:06 devstack sudo[109057]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87412149-a3de-44bc-b5bb-6ac1569bfb2a tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.9140b9a7-9382-4ff6-ad64-04c9a69a6dff 1G" returned: 0 in 0.600s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87412149-a3de-44bc-b5bb-6ac1569bfb2a tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-765c6e99-e315-4d85-9532-2350c5de5717 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.9140b9a7-9382-4ff6-ad64-04c9a69a6dff {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:06 devstack sudo[109063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-765c6e99-e315-4d85-9532-2350c5de5717 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.9140b9a7-9382-4ff6-ad64-04c9a69a6dff
Sep 28 18:31:06 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:07 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87412149-a3de-44bc-b5bb-6ac1569bfb2a tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-765c6e99-e315-4d85-9532-2350c5de5717 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.9140b9a7-9382-4ff6-ad64-04c9a69a6dff" returned: 0 in 0.418s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:07 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-87412149-a3de-44bc-b5bb-6ac1569bfb2a tempest-ProjectReaderTests-257558821 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.9140b9a7-9382-4ff6-ad64-04c9a69a6dff is being set with open permissions: ugo+rw
Sep 28 18:31:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87412149-a3de-44bc-b5bb-6ac1569bfb2a tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.9140b9a7-9382-4ff6-ad64-04c9a69a6dff {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:07 devstack sudo[109068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.9140b9a7-9382-4ff6-ad64-04c9a69a6dff
Sep 28 18:31:07 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:07 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87412149-a3de-44bc-b5bb-6ac1569bfb2a tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.9140b9a7-9382-4ff6-ad64-04c9a69a6dff" returned: 0 in 0.342s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:07 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:31:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Flow 'volume_create_manager' (5c36f37e-8324-4467-aa48-7241bbd208ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd68fc5e-0207-4cab-a48c-e35f1a1eeb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87412149-a3de-44bc-b5bb-6ac1569bfb2a tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:07 devstack sudo[109071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.info
Sep 28 18:31:07 devstack sudo[109071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd68fc5e-0207-4cab-a48c-e35f1a1eeb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29b3656-ac8a-4ab5-ba7d-1db7ad495a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58a2f657b6a4d34bb92576f5a009201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9e4087b3-7d9a-4506-8ac7-a890d5b6f318,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:07Z,use_quota=True,user_id='92fd6b7c354b4eed9531628d99feda72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11aebc97-be38-434a-82f8-539b45012862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11aebc97-be38-434a-82f8-539b45012862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a574d7bd-6b79-4c0d-9763-f33989472018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a574d7bd-6b79-4c0d-9763-f33989472018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b29b3656-ac8a-4ab5-ba7d-1db7ad495a78', 'volume_name': 'volume-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78', 'volume_size': 1, 'snapshot_id': '9e4087b3-7d9a-4506-8ac7-a890d5b6f318'}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a4f085-d955-4c18-b2f5-a4390d68a049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a4f085-d955-4c18-b2f5-a4390d68a049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:07 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dfe1476-349a-4e48-96cf-38c1698abaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:07 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Volume b29b3656-ac8a-4ab5-ba7d-1db7ad495a78: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78', 'volume_size': 1, 'snapshot_id': '9e4087b3-7d9a-4506-8ac7-a890d5b6f318'}
Sep 28 18:31:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:07 devstack sudo[109071]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87412149-a3de-44bc-b5bb-6ac1569bfb2a tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.info" returned: 0 in 0.292s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:07 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-87412149-a3de-44bc-b5bb-6ac1569bfb2a tempest-ProjectReaderTests-257558821 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.info is being set with open permissions: ugo+rw
Sep 28 18:31:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87412149-a3de-44bc-b5bb-6ac1569bfb2a tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:07 devstack sudo[109074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.info
Sep 28 18:31:07 devstack sudo[109074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:08 devstack sudo[109074]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-87412149-a3de-44bc-b5bb-6ac1569bfb2a tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.info" returned: 0 in 0.272s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-87412149-a3de-44bc-b5bb-6ac1569bfb2a tempest-ProjectReaderTests-257558821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.633s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.027s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1088136289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af306f5d-171e-4dfd-93db-fb5412c4fde4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7141bfada145467eb777f5e9601f614e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:06Z,use_quota=True,user_id='19ef54da5952457abebbe56a45760423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:31:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Creating volume af306f5d-171e-4dfd-93db-fb5412c4fde4 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:31:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:08 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:31:08 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:31:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:08 devstack sudo[109077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4 1073741824
Sep 28 18:31:08 devstack sudo[109077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:08 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-87412149-a3de-44bc-b5bb-6ac1569bfb2a tempest-ProjectReaderTests-257558821 None] Create snapshot completed successfully
Sep 28 18:31:08 devstack sudo[109077]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4 1073741824" returned: 0 in 0.529s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:08 devstack sudo[109083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4
Sep 28 18:31:08 devstack sudo[109083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:09 devstack sudo[109083]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4" returned: 0 in 0.329s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.442s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Acquiring lock "cinder-quobyte-9e4087b3-7d9a-4506-8ac7-a890d5b6f318-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78" by "_create_volume_from_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb401ded-0104-44ad-a7e5-8dc258cd5144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af306f5d-171e-4dfd-93db-fb5412c4fde4', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dedeeff-0ffc-4214-9635-149a4b013ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Lock "cinder-quobyte-9e4087b3-7d9a-4506-8ac7-a890d5b6f318-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Creating volume b29b3656-ac8a-4ab5-ba7d-1db7ad495a78 from snapshot 9e4087b3-7d9a-4506-8ac7-a890d5b6f318 {{(pid=87046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Acquiring lock "cinder-quobyte-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78" by "_copy_volume_from_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:09 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Volume volume-af306f5d-171e-4dfd-93db-fb5412c4fde4 (af306f5d-171e-4dfd-93db-fb5412c4fde4): created successfully
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dedeeff-0ffc-4214-9635-149a4b013ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Flow 'volume_create_manager' (c693179e-ebe3-4d47-ab4f-7a16927b5495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-81e33420-90a8-47e6-8c16-b00a32c76aeb tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-9140b9a7-9382-4ff6-ad64-04c9a69a6dff-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Lock "cinder-quobyte-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78" acquired by "_copy_volume_from_snapshot" :: waited 0.055s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] snapshot: 9e4087b3-7d9a-4506-8ac7-a890d5b6f318, volume: b29b3656-ac8a-4ab5-ba7d-1db7ad495a78,  {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 28 18:31:09 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-97592e2b-71d6-4318-8870-6d62fdc73a82 tempest-ProjectMemberTests-2016434849 None] Created volume successfully.
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-81e33420-90a8-47e6-8c16-b00a32c76aeb tempest-ProjectReaderTests-257558821 None] Lock "cinder-9140b9a7-9382-4ff6-ad64-04c9a69a6dff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-81e33420-90a8-47e6-8c16-b00a32c76aeb tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-quobyte-765c6e99-e315-4d85-9532-2350c5de5717" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff3ee11-ee76-4cbe-b3a3-29cf5c0b0aa0]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-81e33420-90a8-47e6-8c16-b00a32c76aeb tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-765c6e99-e315-4d85-9532-2350c5de5717" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-81e33420-90a8-47e6-8c16-b00a32c76aeb tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-quobyte-9140b9a7-9382-4ff6-ad64-04c9a69a6dff" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-81e33420-90a8-47e6-8c16-b00a32c76aeb tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-9140b9a7-9382-4ff6-ad64-04c9a69a6dff" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-81e33420-90a8-47e6-8c16-b00a32c76aeb tempest-ProjectReaderTests-257558821 None] Deleting offline snapshot 9140b9a7-9382-4ff6-ad64-04c9a69a6dff of volume 765c6e99-e315-4d85-9532-2350c5de5717 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-81e33420-90a8-47e6-8c16-b00a32c76aeb tempest-ProjectReaderTests-257558821 None] snapshot_file for this snap is: volume-765c6e99-e315-4d85-9532-2350c5de5717.9140b9a7-9382-4ff6-ad64-04c9a69a6dff {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6d2099-d135-4f14-9478-88fa4cba8557]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-81e33420-90a8-47e6-8c16-b00a32c76aeb tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.9140b9a7-9382-4ff6-ad64-04c9a69a6dff {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:09 devstack sudo[109086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318
Sep 28 18:31:09 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:09 devstack sudo[109088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.9140b9a7-9382-4ff6-ad64-04c9a69a6dff
Sep 28 18:31:09 devstack sudo[109088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:09 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318" returned: 0 in 0.481s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf78190-cc6d-42ce-aad1-a833e3058ec5]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:09 devstack sudo[109088]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-81e33420-90a8-47e6-8c16-b00a32c76aeb tempest-ProjectReaderTests-257558821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.9140b9a7-9382-4ff6-ad64-04c9a69a6dff" returned: 0 in 0.430s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-81e33420-90a8-47e6-8c16-b00a32c76aeb tempest-ProjectReaderTests-257558821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-765c6e99-e315-4d85-9532-2350c5de5717(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b14cb1-0038-4bb0-a5f0-f6d2214d7cb7]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-81e33420-90a8-47e6-8c16-b00a32c76aeb tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:09 devstack sudo[109097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b
Sep 28 18:31:09 devstack sudo[109097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:09 devstack sudo[109098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717
Sep 28 18:31:09 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:10 devstack sudo[109097]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b" returned: 0 in 0.475s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:10 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 28 18:31:10 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Creating direct copy from snapshot {{(pid=87046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 28 18:31:10 devstack cinder-volume[87046]: DEBUG cinder.utils [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Path /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78 not found in is_blk_device check {{(pid=87046) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 28 18:31:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:10 devstack sudo[109107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78
Sep 28 18:31:10 devstack sudo[109107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:10 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-81e33420-90a8-47e6-8c16-b00a32c76aeb tempest-ProjectReaderTests-257558821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717" returned: 0 in 0.501s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-81e33420-90a8-47e6-8c16-b00a32c76aeb tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.9140b9a7-9382-4ff6-ad64-04c9a69a6dff {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:10 devstack sudo[109109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.9140b9a7-9382-4ff6-ad64-04c9a69a6dff
Sep 28 18:31:10 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2bfeb704-b495-45ba-8318-a030ccdc0ada tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:10 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-81e33420-90a8-47e6-8c16-b00a32c76aeb tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.9140b9a7-9382-4ff6-ad64-04c9a69a6dff" returned: 0 in 0.409s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-81e33420-90a8-47e6-8c16-b00a32c76aeb tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.9140b9a7-9382-4ff6-ad64-04c9a69a6dff {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:10 devstack sudo[109120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.9140b9a7-9382-4ff6-ad64-04c9a69a6dff
Sep 28 18:31:10 devstack sudo[109120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:11 devstack sudo[109120]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-81e33420-90a8-47e6-8c16-b00a32c76aeb tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717.9140b9a7-9382-4ff6-ad64-04c9a69a6dff" returned: 0 in 0.538s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-81e33420-90a8-47e6-8c16-b00a32c76aeb tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-9140b9a7-9382-4ff6-ad64-04c9a69a6dff" released by "_delete_snapshot" :: held 2.043s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-81e33420-90a8-47e6-8c16-b00a32c76aeb tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-765c6e99-e315-4d85-9532-2350c5de5717" released by "delete_snapshot" :: held 2.076s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:11 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-81e33420-90a8-47e6-8c16-b00a32c76aeb tempest-ProjectReaderTests-257558821 None] Created reservations ['0ff22554-6f16-4a73-8c0f-84e6b8651ec2', '24230916-9ff6-4582-8710-40534dbc1718', '7bbc5b6c-ace4-4a39-b0f7-0a1611f04624', '3ae4ae9c-f138-488f-9180-2ba69fba6a12'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:11 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-81e33420-90a8-47e6-8c16-b00a32c76aeb tempest-ProjectReaderTests-257558821 None] Delete snapshot completed successfully.
Sep 28 18:31:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-81e33420-90a8-47e6-8c16-b00a32c76aeb tempest-ProjectReaderTests-257558821 None] Lock "cinder-9140b9a7-9382-4ff6-ad64-04c9a69a6dff-delete_snapshot" released by "delete_snapshot" :: held 2.466s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:12 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d65ef4d7-8135-499d-a5a6-828aa77b04ac tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-765c6e99-e315-4d85-9532-2350c5de5717-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:12 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d65ef4d7-8135-499d-a5a6-828aa77b04ac tempest-ProjectReaderTests-257558821 None] Lock "cinder-765c6e99-e315-4d85-9532-2350c5de5717-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:12 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d65ef4d7-8135-499d-a5a6-828aa77b04ac tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-quobyte-765c6e99-e315-4d85-9532-2350c5de5717" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:12 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d65ef4d7-8135-499d-a5a6-828aa77b04ac tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-765c6e99-e315-4d85-9532-2350c5de5717" acquired by "delete_volume" :: waited 0.044s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:12 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f6d884-eb19-48f8-a945-67ac66a0d8ae]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d65ef4d7-8135-499d-a5a6-828aa77b04ac tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:13 devstack sudo[109129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717
Sep 28 18:31:13 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:13 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d65ef4d7-8135-499d-a5a6-828aa77b04ac tempest-ProjectReaderTests-257558821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717" returned: 0 in 0.732s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d65ef4d7-8135-499d-a5a6-828aa77b04ac tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:13 devstack sudo[109135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717
Sep 28 18:31:13 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:13 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d65ef4d7-8135-499d-a5a6-828aa77b04ac tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-765c6e99-e315-4d85-9532-2350c5de5717" returned: 0 in 0.404s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:14 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d65ef4d7-8135-499d-a5a6-828aa77b04ac tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-765c6e99-e315-4d85-9532-2350c5de5717" released by "delete_volume" :: held 1.312s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:14 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-d65ef4d7-8135-499d-a5a6-828aa77b04ac tempest-ProjectReaderTests-257558821 None] Created reservations ['b5aba7dc-9bb7-40a2-bed5-603bdf2edbde', '40b61ce6-bff9-4c52-9d51-4d00b5b41106', 'b30170fb-42f0-4773-9afd-f8cc6d63adb9', '32ad6d7e-cb02-42e4-a9ce-de458ed54378'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d65ef4d7-8135-499d-a5a6-828aa77b04ac tempest-ProjectReaderTests-257558821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d65ef4d7-8135-499d-a5a6-828aa77b04ac tempest-ProjectReaderTests-257558821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d65ef4d7-8135-499d-a5a6-828aa77b04ac tempest-ProjectReaderTests-257558821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d65ef4d7-8135-499d-a5a6-828aa77b04ac tempest-ProjectReaderTests-257558821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d65ef4d7-8135-499d-a5a6-828aa77b04ac tempest-ProjectReaderTests-257558821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d65ef4d7-8135-499d-a5a6-828aa77b04ac tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:14 devstack sudo[109138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:31:14 devstack sudo[109138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:14 devstack sudo[109138]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d65ef4d7-8135-499d-a5a6-828aa77b04ac tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.395s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:14 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d65ef4d7-8135-499d-a5a6-828aa77b04ac tempest-ProjectReaderTests-257558821 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:31:14 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d65ef4d7-8135-499d-a5a6-828aa77b04ac tempest-ProjectReaderTests-257558821 None] Deleted volume successfully.
Sep 28 18:31:14 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d65ef4d7-8135-499d-a5a6-828aa77b04ac tempest-ProjectReaderTests-257558821 None] Lock "cinder-765c6e99-e315-4d85-9532-2350c5de5717-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:15 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:31:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Flow 'volume_create_manager' (102b5662-dd31-4e31-9e9e-b54228686949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12ff4fc-c982-46a2-95d1-c4f26996e5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12ff4fc-c982-46a2-95d1-c4f26996e5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1128736984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4130921-37b8-41db-aa87-6a265af0e243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa1f17ecf644a9b93b4b4d10bad8593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:16Z,use_quota=True,user_id='215f54ccefe14730a0310f724f3df258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a0ca219-7992-49a3-9eb2-2d905129f49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a0ca219-7992-49a3-9eb2-2d905129f49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb34700-3bdc-4dd5-a2b6-70201a1f856b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb34700-3bdc-4dd5-a2b6-70201a1f856b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4130921-37b8-41db-aa87-6a265af0e243', 'volume_name': 'volume-b4130921-37b8-41db-aa87-6a265af0e243', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:15 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (330b5c79-d691-43cf-ade4-410cc5f93426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (330b5c79-d691-43cf-ade4-410cc5f93426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:16 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70471fb8-2c26-4f01-b8fe-f7c7e7e08a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:16 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Volume b4130921-37b8-41db-aa87-6a265af0e243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4130921-37b8-41db-aa87-6a265af0e243', 'volume_size': 1}
Sep 28 18:31:16 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:17 devstack sudo[109107]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78" returned: 0 in 7.172s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:17 devstack cinder-volume[87046]: DEBUG cinder.image.image_utils [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Image conversion details: src /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b, size 1024.00 MB, duration 7.17 sec, destination /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78 {{(pid=87046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 28 18:31:17 devstack cinder-volume[87046]: INFO cinder.image.image_utils [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Converted 1024.00 MB image at 142.76 MB/s
Sep 28 18:31:17 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78 is being set with open permissions: ugo+rw
Sep 28 18:31:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:17 devstack sudo[109141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78
Sep 28 18:31:17 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:17 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78" returned: 0 in 0.253s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:17 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Lock "cinder-quobyte-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78" released by "_copy_volume_from_snapshot" :: held 8.508s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:17 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Lock "cinder-quobyte-9e4087b3-7d9a-4506-8ac7-a890d5b6f318-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78" released by "_create_volume_from_snapshot" :: held 8.637s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.688s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2bfeb704-b495-45ba-8318-a030ccdc0ada tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.260s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:17 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-2bfeb704-b495-45ba-8318-a030ccdc0ada tempest-ProjectMemberTests-2016434849 None] Creating offline snapshot bfbd580e-b46d-4894-8537-6d3f9cd93751 of volume af306f5d-171e-4dfd-93db-fb5412c4fde4 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:31:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dfe1476-349a-4e48-96cf-38c1698abaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78', 'volume_size': 1, 'snapshot_id': '9e4087b3-7d9a-4506-8ac7-a890d5b6f318'}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee210cf-e314-4da5-81d0-e8dabd8429dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:17 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd73846d-89ae-4143-8d60-acb348f0962b]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:17 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2bfeb704-b495-45ba-8318-a030ccdc0ada tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:17 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Volume volume-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78 (b29b3656-ac8a-4ab5-ba7d-1db7ad495a78): created successfully
Sep 28 18:31:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee210cf-e314-4da5-81d0-e8dabd8429dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:17 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Flow 'volume_create_manager' (5c36f37e-8324-4467-aa48-7241bbd208ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:17 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-6cc64b83-d92a-4b61-b86b-18ccd0c301f9 tempest-SnapshotDependencyTests-400063745 None] Created volume successfully.
Sep 28 18:31:17 devstack sudo[109144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4
Sep 28 18:31:17 devstack sudo[109144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:18 devstack sudo[109144]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2bfeb704-b495-45ba-8318-a030ccdc0ada tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4" returned: 0 in 0.451s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2bfeb704-b495-45ba-8318-a030ccdc0ada tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.bfbd580e-b46d-4894-8537-6d3f9cd93751 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:18 devstack sudo[109149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.bfbd580e-b46d-4894-8537-6d3f9cd93751 1G
Sep 28 18:31:18 devstack sudo[109149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:18 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e1a114ba-abed-479e-bfc6-57228fdfc319 tempest-SnapshotDependencyTests-400063745 None] Acquiring lock "cinder-9e4087b3-7d9a-4506-8ac7-a890d5b6f318-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:18 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e1a114ba-abed-479e-bfc6-57228fdfc319 tempest-SnapshotDependencyTests-400063745 None] Lock "cinder-9e4087b3-7d9a-4506-8ac7-a890d5b6f318-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:18 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e1a114ba-abed-479e-bfc6-57228fdfc319 tempest-SnapshotDependencyTests-400063745 None] Acquiring lock "cinder-quobyte-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:18 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e1a114ba-abed-479e-bfc6-57228fdfc319 tempest-SnapshotDependencyTests-400063745 None] Lock "cinder-quobyte-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:18 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e1a114ba-abed-479e-bfc6-57228fdfc319 tempest-SnapshotDependencyTests-400063745 None] Acquiring lock "cinder-quobyte-9e4087b3-7d9a-4506-8ac7-a890d5b6f318" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:18 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e1a114ba-abed-479e-bfc6-57228fdfc319 tempest-SnapshotDependencyTests-400063745 None] Lock "cinder-quobyte-9e4087b3-7d9a-4506-8ac7-a890d5b6f318" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:18 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-e1a114ba-abed-479e-bfc6-57228fdfc319 tempest-SnapshotDependencyTests-400063745 None] Deleting offline snapshot 9e4087b3-7d9a-4506-8ac7-a890d5b6f318 of volume d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:31:18 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-e1a114ba-abed-479e-bfc6-57228fdfc319 tempest-SnapshotDependencyTests-400063745 None] snapshot_file for this snap is: volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:31:18 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffacee0-3962-4ef5-8ecb-091ae0219593]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e1a114ba-abed-479e-bfc6-57228fdfc319 tempest-SnapshotDependencyTests-400063745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:18 devstack sudo[109149]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2bfeb704-b495-45ba-8318-a030ccdc0ada tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.bfbd580e-b46d-4894-8537-6d3f9cd93751 1G" returned: 0 in 0.485s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:18 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2bfeb704-b495-45ba-8318-a030ccdc0ada tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af306f5d-171e-4dfd-93db-fb5412c4fde4 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.bfbd580e-b46d-4894-8537-6d3f9cd93751 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:18 devstack sudo[109156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af306f5d-171e-4dfd-93db-fb5412c4fde4 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.bfbd580e-b46d-4894-8537-6d3f9cd93751
Sep 28 18:31:18 devstack sudo[109156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:18 devstack sudo[109155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318
Sep 28 18:31:18 devstack sudo[109155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:19 devstack sudo[109156]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2bfeb704-b495-45ba-8318-a030ccdc0ada tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af306f5d-171e-4dfd-93db-fb5412c4fde4 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.bfbd580e-b46d-4894-8537-6d3f9cd93751" returned: 0 in 0.372s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:19 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-2bfeb704-b495-45ba-8318-a030ccdc0ada tempest-ProjectMemberTests-2016434849 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.bfbd580e-b46d-4894-8537-6d3f9cd93751 is being set with open permissions: ugo+rw
Sep 28 18:31:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2bfeb704-b495-45ba-8318-a030ccdc0ada tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.bfbd580e-b46d-4894-8537-6d3f9cd93751 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:19 devstack sudo[109167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.bfbd580e-b46d-4894-8537-6d3f9cd93751
Sep 28 18:31:19 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:19 devstack sudo[109155]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e1a114ba-abed-479e-bfc6-57228fdfc319 tempest-SnapshotDependencyTests-400063745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318" returned: 0 in 0.449s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:19 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-e1a114ba-abed-479e-bfc6-57228fdfc319 tempest-SnapshotDependencyTests-400063745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:31:19 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[91da3184-d6a3-405d-832e-546bf0d72783]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e1a114ba-abed-479e-bfc6-57228fdfc319 tempest-SnapshotDependencyTests-400063745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:19 devstack sudo[109169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b
Sep 28 18:31:19 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:19 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2bfeb704-b495-45ba-8318-a030ccdc0ada tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.bfbd580e-b46d-4894-8537-6d3f9cd93751" returned: 0 in 0.270s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2bfeb704-b495-45ba-8318-a030ccdc0ada tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:19 devstack sudo[109172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.info
Sep 28 18:31:19 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:19 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2bfeb704-b495-45ba-8318-a030ccdc0ada tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.info" returned: 0 in 0.270s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:19 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-2bfeb704-b495-45ba-8318-a030ccdc0ada tempest-ProjectMemberTests-2016434849 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.info is being set with open permissions: ugo+rw
Sep 28 18:31:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2bfeb704-b495-45ba-8318-a030ccdc0ada tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:19 devstack sudo[109177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.info
Sep 28 18:31:19 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:19 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e1a114ba-abed-479e-bfc6-57228fdfc319 tempest-SnapshotDependencyTests-400063745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b" returned: 0 in 0.561s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e1a114ba-abed-479e-bfc6-57228fdfc319 tempest-SnapshotDependencyTests-400063745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:19 devstack sudo[109180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318
Sep 28 18:31:19 devstack sudo[109180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:19 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:19 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2bfeb704-b495-45ba-8318-a030ccdc0ada tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.info" returned: 0 in 0.267s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2bfeb704-b495-45ba-8318-a030ccdc0ada tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.251s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1128736984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4130921-37b8-41db-aa87-6a265af0e243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa1f17ecf644a9b93b4b4d10bad8593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:16Z,use_quota=True,user_id='215f54ccefe14730a0310f724f3df258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Creating volume b4130921-37b8-41db-aa87-6a265af0e243 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:31:20 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:20 devstack sudo[109185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243 1073741824
Sep 28 18:31:20 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:20 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-2bfeb704-b495-45ba-8318-a030ccdc0ada tempest-ProjectMemberTests-2016434849 None] Create snapshot completed successfully
Sep 28 18:31:20 devstack sudo[109180]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e1a114ba-abed-479e-bfc6-57228fdfc319 tempest-SnapshotDependencyTests-400063745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318" returned: 0 in 0.389s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e1a114ba-abed-479e-bfc6-57228fdfc319 tempest-SnapshotDependencyTests-400063745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:20 devstack sudo[109189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318
Sep 28 18:31:20 devstack sudo[109189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:20 devstack sudo[109189]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e1a114ba-abed-479e-bfc6-57228fdfc319 tempest-SnapshotDependencyTests-400063745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b.9e4087b3-7d9a-4506-8ac7-a890d5b6f318" returned: 0 in 0.283s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e1a114ba-abed-479e-bfc6-57228fdfc319 tempest-SnapshotDependencyTests-400063745 None] Lock "cinder-quobyte-9e4087b3-7d9a-4506-8ac7-a890d5b6f318" released by "_delete_snapshot" :: held 1.801s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e1a114ba-abed-479e-bfc6-57228fdfc319 tempest-SnapshotDependencyTests-400063745 None] Lock "cinder-quobyte-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b" released by "delete_snapshot" :: held 1.827s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:20 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243 1073741824" returned: 0 in 0.493s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:20 devstack sudo[109195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-e1a114ba-abed-479e-bfc6-57228fdfc319 tempest-SnapshotDependencyTests-400063745 None] Created reservations ['7708300c-878c-4df7-b2f1-b7a2a20ebfa9', '666fe812-e796-4e46-a016-55561c5e05fc', 'abf33100-8a1a-4326-8e77-af01a23d51bd', '79e75fae-4249-446a-98e5-033c018c6cbd'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:20 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:20 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-e1a114ba-abed-479e-bfc6-57228fdfc319 tempest-SnapshotDependencyTests-400063745 None] Delete snapshot completed successfully.
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e1a114ba-abed-479e-bfc6-57228fdfc319 tempest-SnapshotDependencyTests-400063745 None] Lock "cinder-9e4087b3-7d9a-4506-8ac7-a890d5b6f318-delete_snapshot" released by "delete_snapshot" :: held 2.051s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-56a85ea4-6d49-436d-8307-7415207b4d47 tempest-SnapshotDependencyTests-400063745 None] Acquiring lock "cinder-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-56a85ea4-6d49-436d-8307-7415207b4d47 tempest-SnapshotDependencyTests-400063745 None] Lock "cinder-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-56a85ea4-6d49-436d-8307-7415207b4d47 tempest-SnapshotDependencyTests-400063745 None] Acquiring lock "cinder-quobyte-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-56a85ea4-6d49-436d-8307-7415207b4d47 tempest-SnapshotDependencyTests-400063745 None] Lock "cinder-quobyte-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b" acquired by "delete_volume" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:20 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243" returned: 0 in 0.325s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70471fb8-2c26-4f01-b8fe-f7c7e7e08a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4130921-37b8-41db-aa87-6a265af0e243', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce9fd2ee-30f7-4a9c-bd13-15e4f23b9259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec09dc4a-599f-4e55-a848-a182694c7de3]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:20 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-56a85ea4-6d49-436d-8307-7415207b4d47 tempest-SnapshotDependencyTests-400063745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:21 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Volume volume-b4130921-37b8-41db-aa87-6a265af0e243 (b4130921-37b8-41db-aa87-6a265af0e243): created successfully
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce9fd2ee-30f7-4a9c-bd13-15e4f23b9259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Flow 'volume_create_manager' (102b5662-dd31-4e31-9e9e-b54228686949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:21 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-226096dd-76e3-48db-a726-664271566d61 tempest-ProjectReaderTests-257558821 None] Created volume successfully.
Sep 28 18:31:21 devstack sudo[109199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b
Sep 28 18:31:21 devstack sudo[109199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-49af3a2b-0083-431a-985a-e074e129e80a tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-bfbd580e-b46d-4894-8537-6d3f9cd93751-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-49af3a2b-0083-431a-985a-e074e129e80a tempest-ProjectMemberTests-2016434849 None] Lock "cinder-bfbd580e-b46d-4894-8537-6d3f9cd93751-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-49af3a2b-0083-431a-985a-e074e129e80a tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-af306f5d-171e-4dfd-93db-fb5412c4fde4" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-49af3a2b-0083-431a-985a-e074e129e80a tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-af306f5d-171e-4dfd-93db-fb5412c4fde4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-49af3a2b-0083-431a-985a-e074e129e80a tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-bfbd580e-b46d-4894-8537-6d3f9cd93751" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-49af3a2b-0083-431a-985a-e074e129e80a tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-bfbd580e-b46d-4894-8537-6d3f9cd93751" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-49af3a2b-0083-431a-985a-e074e129e80a tempest-ProjectMemberTests-2016434849 None] Deleting offline snapshot bfbd580e-b46d-4894-8537-6d3f9cd93751 of volume af306f5d-171e-4dfd-93db-fb5412c4fde4 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-49af3a2b-0083-431a-985a-e074e129e80a tempest-ProjectMemberTests-2016434849 None] snapshot_file for this snap is: volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.bfbd580e-b46d-4894-8537-6d3f9cd93751 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e66680-66ec-46f5-b354-2a8f89c7f5a3]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-49af3a2b-0083-431a-985a-e074e129e80a tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.bfbd580e-b46d-4894-8537-6d3f9cd93751 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-64a17c9e-dcae-4509-a8fa-bebb9ab339d5 tempest-ProjectReaderTests-257558821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-64a17c9e-dcae-4509-a8fa-bebb9ab339d5 tempest-ProjectReaderTests-257558821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-64a17c9e-dcae-4509-a8fa-bebb9ab339d5 tempest-ProjectReaderTests-257558821 None] Creating offline snapshot bc1250bd-e089-4e67-a9ea-f97e1ebd84a9 of volume b4130921-37b8-41db-aa87-6a265af0e243 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4fa504-f81e-4fdc-8849-4cdeec3487fa]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-64a17c9e-dcae-4509-a8fa-bebb9ab339d5 tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:21 devstack sudo[109199]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-56a85ea4-6d49-436d-8307-7415207b4d47 tempest-SnapshotDependencyTests-400063745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b" returned: 0 in 0.503s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-56a85ea4-6d49-436d-8307-7415207b4d47 tempest-SnapshotDependencyTests-400063745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:21 devstack sudo[109208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b
Sep 28 18:31:21 devstack sudo[109208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:21 devstack sudo[109202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.bfbd580e-b46d-4894-8537-6d3f9cd93751
Sep 28 18:31:21 devstack sudo[109202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:21 devstack sudo[109207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243
Sep 28 18:31:21 devstack sudo[109207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:21 devstack sudo[109208]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-56a85ea4-6d49-436d-8307-7415207b4d47 tempest-SnapshotDependencyTests-400063745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b" returned: 0 in 0.274s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-56a85ea4-6d49-436d-8307-7415207b4d47 tempest-SnapshotDependencyTests-400063745 None] Lock "cinder-quobyte-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b" released by "delete_volume" :: held 0.869s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:21 devstack sudo[109202]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-49af3a2b-0083-431a-985a-e074e129e80a tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.bfbd580e-b46d-4894-8537-6d3f9cd93751" returned: 0 in 0.474s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-49af3a2b-0083-431a-985a-e074e129e80a tempest-ProjectMemberTests-2016434849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af306f5d-171e-4dfd-93db-fb5412c4fde4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-56a85ea4-6d49-436d-8307-7415207b4d47 tempest-SnapshotDependencyTests-400063745 None] Created reservations ['98961b51-0353-4fce-874e-082f4a83832e', '9038409f-6a7d-4d1d-8527-55a3808b491f', 'ac16a908-2d7e-4950-a194-15c4bc192052', 'a7c8ac07-703e-40ae-91a3-ae76bcdaac5b'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f39240-8bcc-412d-8e39-a060d49eef9f]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-49af3a2b-0083-431a-985a-e074e129e80a tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:21 devstack sudo[109207]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-64a17c9e-dcae-4509-a8fa-bebb9ab339d5 tempest-ProjectReaderTests-257558821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243" returned: 0 in 0.436s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-64a17c9e-dcae-4509-a8fa-bebb9ab339d5 tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.bc1250bd-e089-4e67-a9ea-f97e1ebd84a9 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:21 devstack sudo[109220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.bc1250bd-e089-4e67-a9ea-f97e1ebd84a9 1G
Sep 28 18:31:21 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-56a85ea4-6d49-436d-8307-7415207b4d47 tempest-SnapshotDependencyTests-400063745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-56a85ea4-6d49-436d-8307-7415207b4d47 tempest-SnapshotDependencyTests-400063745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-56a85ea4-6d49-436d-8307-7415207b4d47 tempest-SnapshotDependencyTests-400063745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-56a85ea4-6d49-436d-8307-7415207b4d47 tempest-SnapshotDependencyTests-400063745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-56a85ea4-6d49-436d-8307-7415207b4d47 tempest-SnapshotDependencyTests-400063745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:21 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-56a85ea4-6d49-436d-8307-7415207b4d47 tempest-SnapshotDependencyTests-400063745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:22 devstack sudo[109219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4
Sep 28 18:31:22 devstack sudo[109219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:22 devstack sudo[109222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:31:22 devstack sudo[109222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d9af5fba-aa0f-4f8f-ae9d-4254a47fb979 tempest-SnapshotDependencyTests-400063745 None] Acquiring lock "cinder-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d9af5fba-aa0f-4f8f-ae9d-4254a47fb979 tempest-SnapshotDependencyTests-400063745 None] Lock "cinder-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d9af5fba-aa0f-4f8f-ae9d-4254a47fb979 tempest-SnapshotDependencyTests-400063745 None] Acquiring lock "cinder-quobyte-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d9af5fba-aa0f-4f8f-ae9d-4254a47fb979 tempest-SnapshotDependencyTests-400063745 None] Lock "cinder-quobyte-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78" acquired by "delete_volume" :: waited 0.023s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:22 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[792cdfeb-9335-4f99-a458-dc64b8225bbd]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d9af5fba-aa0f-4f8f-ae9d-4254a47fb979 tempest-SnapshotDependencyTests-400063745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:22 devstack sudo[109219]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-49af3a2b-0083-431a-985a-e074e129e80a tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4" returned: 0 in 0.485s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-49af3a2b-0083-431a-985a-e074e129e80a tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.bfbd580e-b46d-4894-8537-6d3f9cd93751 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:22 devstack sudo[109225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78
Sep 28 18:31:22 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:22 devstack sudo[109222]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-56a85ea4-6d49-436d-8307-7415207b4d47 tempest-SnapshotDependencyTests-400063745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.392s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:22 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-56a85ea4-6d49-436d-8307-7415207b4d47 tempest-SnapshotDependencyTests-400063745 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:31:22 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-56a85ea4-6d49-436d-8307-7415207b4d47 tempest-SnapshotDependencyTests-400063745 None] Deleted volume successfully.
Sep 28 18:31:22 devstack sudo[109233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.bfbd580e-b46d-4894-8537-6d3f9cd93751
Sep 28 18:31:22 devstack sudo[109233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:22 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-56a85ea4-6d49-436d-8307-7415207b4d47 tempest-SnapshotDependencyTests-400063745 None] Lock "cinder-d44bb7b6-cfa1-48bd-a55b-478ed6fbcc2b-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:22 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-64a17c9e-dcae-4509-a8fa-bebb9ab339d5 tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.bc1250bd-e089-4e67-a9ea-f97e1ebd84a9 1G" returned: 0 in 0.601s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-64a17c9e-dcae-4509-a8fa-bebb9ab339d5 tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4130921-37b8-41db-aa87-6a265af0e243 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.bc1250bd-e089-4e67-a9ea-f97e1ebd84a9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:22 devstack sudo[109237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4130921-37b8-41db-aa87-6a265af0e243 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.bc1250bd-e089-4e67-a9ea-f97e1ebd84a9
Sep 28 18:31:22 devstack sudo[109237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:22 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d9af5fba-aa0f-4f8f-ae9d-4254a47fb979 tempest-SnapshotDependencyTests-400063745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78" returned: 0 in 0.461s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d9af5fba-aa0f-4f8f-ae9d-4254a47fb979 tempest-SnapshotDependencyTests-400063745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:22 devstack sudo[109245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78
Sep 28 18:31:22 devstack sudo[109245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:22 devstack sudo[109233]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-49af3a2b-0083-431a-985a-e074e129e80a tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.bfbd580e-b46d-4894-8537-6d3f9cd93751" returned: 0 in 0.436s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-49af3a2b-0083-431a-985a-e074e129e80a tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.bfbd580e-b46d-4894-8537-6d3f9cd93751 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:22 devstack sudo[109250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.bfbd580e-b46d-4894-8537-6d3f9cd93751
Sep 28 18:31:22 devstack sudo[109250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:22 devstack sudo[109237]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-64a17c9e-dcae-4509-a8fa-bebb9ab339d5 tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4130921-37b8-41db-aa87-6a265af0e243 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.bc1250bd-e089-4e67-a9ea-f97e1ebd84a9" returned: 0 in 0.356s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:22 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-64a17c9e-dcae-4509-a8fa-bebb9ab339d5 tempest-ProjectReaderTests-257558821 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.bc1250bd-e089-4e67-a9ea-f97e1ebd84a9 is being set with open permissions: ugo+rw
Sep 28 18:31:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-64a17c9e-dcae-4509-a8fa-bebb9ab339d5 tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.bc1250bd-e089-4e67-a9ea-f97e1ebd84a9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:22 devstack sudo[109252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.bc1250bd-e089-4e67-a9ea-f97e1ebd84a9
Sep 28 18:31:22 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:22 devstack sudo[109245]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:22 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d9af5fba-aa0f-4f8f-ae9d-4254a47fb979 tempest-SnapshotDependencyTests-400063745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78" returned: 0 in 0.298s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d9af5fba-aa0f-4f8f-ae9d-4254a47fb979 tempest-SnapshotDependencyTests-400063745 None] Lock "cinder-quobyte-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78" released by "delete_volume" :: held 0.830s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=136,cinder:UPDATE=180,cinder:INSERT=43,cinder:DELETE=13 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=137,cinder:UPDATE=174,cinder:INSERT=48,cinder:DELETE=18 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:31:23 devstack sudo[109250]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-d9af5fba-aa0f-4f8f-ae9d-4254a47fb979 tempest-SnapshotDependencyTests-400063745 None] Created reservations ['d319f02b-1322-4b07-a1ce-90703adeb267', '0968ef75-c08d-42f0-81e4-cd03f6bf9b59', '7758ae6f-f932-4649-b34f-ec1f33dc8976', '394e7f82-8451-4370-924b-3ba5d4618eeb'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-49af3a2b-0083-431a-985a-e074e129e80a tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4.bfbd580e-b46d-4894-8537-6d3f9cd93751" returned: 0 in 0.285s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-49af3a2b-0083-431a-985a-e074e129e80a tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-bfbd580e-b46d-4894-8537-6d3f9cd93751" released by "_delete_snapshot" :: held 1.840s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-49af3a2b-0083-431a-985a-e074e129e80a tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-af306f5d-171e-4dfd-93db-fb5412c4fde4" released by "delete_snapshot" :: held 1.873s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:23 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-64a17c9e-dcae-4509-a8fa-bebb9ab339d5 tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.bc1250bd-e089-4e67-a9ea-f97e1ebd84a9" returned: 0 in 0.321s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-64a17c9e-dcae-4509-a8fa-bebb9ab339d5 tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d9af5fba-aa0f-4f8f-ae9d-4254a47fb979 tempest-SnapshotDependencyTests-400063745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d9af5fba-aa0f-4f8f-ae9d-4254a47fb979 tempest-SnapshotDependencyTests-400063745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d9af5fba-aa0f-4f8f-ae9d-4254a47fb979 tempest-SnapshotDependencyTests-400063745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d9af5fba-aa0f-4f8f-ae9d-4254a47fb979 tempest-SnapshotDependencyTests-400063745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d9af5fba-aa0f-4f8f-ae9d-4254a47fb979 tempest-SnapshotDependencyTests-400063745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d9af5fba-aa0f-4f8f-ae9d-4254a47fb979 tempest-SnapshotDependencyTests-400063745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:23 devstack sudo[109257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.info
Sep 28 18:31:23 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-49af3a2b-0083-431a-985a-e074e129e80a tempest-ProjectMemberTests-2016434849 None] Created reservations ['c44ba048-8378-438a-bd35-8921e2b5f2ca', '14e2031a-672e-4bff-8617-e560674bbe4d', '1ea857f2-c4c4-440e-b7b0-0ce465f39ca4', 'db91c491-d3f3-45a0-bd0b-bd2dc33ce57a'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:23 devstack sudo[109259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:31:23 devstack sudo[109259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:23 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-49af3a2b-0083-431a-985a-e074e129e80a tempest-ProjectMemberTests-2016434849 None] Delete snapshot completed successfully.
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-49af3a2b-0083-431a-985a-e074e129e80a tempest-ProjectMemberTests-2016434849 None] Lock "cinder-bfbd580e-b46d-4894-8537-6d3f9cd93751-delete_snapshot" released by "delete_snapshot" :: held 2.180s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:23 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-64a17c9e-dcae-4509-a8fa-bebb9ab339d5 tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.info" returned: 0 in 0.346s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:23 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-64a17c9e-dcae-4509-a8fa-bebb9ab339d5 tempest-ProjectReaderTests-257558821 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.info is being set with open permissions: ugo+rw
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-64a17c9e-dcae-4509-a8fa-bebb9ab339d5 tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:23 devstack sudo[109259]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d9af5fba-aa0f-4f8f-ae9d-4254a47fb979 tempest-SnapshotDependencyTests-400063745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.329s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d9af5fba-aa0f-4f8f-ae9d-4254a47fb979 tempest-SnapshotDependencyTests-400063745 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:31:23 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d9af5fba-aa0f-4f8f-ae9d-4254a47fb979 tempest-SnapshotDependencyTests-400063745 None] Deleted volume successfully.
Sep 28 18:31:23 devstack sudo[109264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.info
Sep 28 18:31:23 devstack sudo[109264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d9af5fba-aa0f-4f8f-ae9d-4254a47fb979 tempest-SnapshotDependencyTests-400063745 None] Lock "cinder-b29b3656-ac8a-4ab5-ba7d-1db7ad495a78-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:23 devstack sudo[109264]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-64a17c9e-dcae-4509-a8fa-bebb9ab339d5 tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.info" returned: 0 in 0.292s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:23 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-64a17c9e-dcae-4509-a8fa-bebb9ab339d5 tempest-ProjectReaderTests-257558821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.462s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:23 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-64a17c9e-dcae-4509-a8fa-bebb9ab339d5 tempest-ProjectReaderTests-257558821 None] Create snapshot completed successfully
Sep 28 18:31:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d2536a3e-531d-42ce-a877-70e0882eb4bf tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-af306f5d-171e-4dfd-93db-fb5412c4fde4-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d2536a3e-531d-42ce-a877-70e0882eb4bf tempest-ProjectMemberTests-2016434849 None] Lock "cinder-af306f5d-171e-4dfd-93db-fb5412c4fde4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d2536a3e-531d-42ce-a877-70e0882eb4bf tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-af306f5d-171e-4dfd-93db-fb5412c4fde4" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d2536a3e-531d-42ce-a877-70e0882eb4bf tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-af306f5d-171e-4dfd-93db-fb5412c4fde4" acquired by "delete_volume" :: waited 0.019s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:24 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f50d44-84d4-4c82-aaad-03671e21e1f4]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d2536a3e-531d-42ce-a877-70e0882eb4bf tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-80f9e873-10d9-4697-ba60-048cca219c2d tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-bc1250bd-e089-4e67-a9ea-f97e1ebd84a9-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-80f9e873-10d9-4697-ba60-048cca219c2d tempest-ProjectReaderTests-257558821 None] Lock "cinder-bc1250bd-e089-4e67-a9ea-f97e1ebd84a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-80f9e873-10d9-4697-ba60-048cca219c2d tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-quobyte-b4130921-37b8-41db-aa87-6a265af0e243" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-80f9e873-10d9-4697-ba60-048cca219c2d tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-b4130921-37b8-41db-aa87-6a265af0e243" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-80f9e873-10d9-4697-ba60-048cca219c2d tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-quobyte-bc1250bd-e089-4e67-a9ea-f97e1ebd84a9" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:24 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-80f9e873-10d9-4697-ba60-048cca219c2d tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-bc1250bd-e089-4e67-a9ea-f97e1ebd84a9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-80f9e873-10d9-4697-ba60-048cca219c2d tempest-ProjectReaderTests-257558821 None] Deleting offline snapshot bc1250bd-e089-4e67-a9ea-f97e1ebd84a9 of volume b4130921-37b8-41db-aa87-6a265af0e243 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:31:24 devstack sudo[109267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4
Sep 28 18:31:24 devstack sudo[109267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:24 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-80f9e873-10d9-4697-ba60-048cca219c2d tempest-ProjectReaderTests-257558821 None] snapshot_file for this snap is: volume-b4130921-37b8-41db-aa87-6a265af0e243.bc1250bd-e089-4e67-a9ea-f97e1ebd84a9 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:31:24 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27e5073-edbf-4b6d-a84f-e0bc3c4a38cc]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:24 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-80f9e873-10d9-4697-ba60-048cca219c2d tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.bc1250bd-e089-4e67-a9ea-f97e1ebd84a9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:24 devstack sudo[109269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.bc1250bd-e089-4e67-a9ea-f97e1ebd84a9
Sep 28 18:31:24 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:25 devstack sudo[109267]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d2536a3e-531d-42ce-a877-70e0882eb4bf tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4" returned: 0 in 0.438s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d2536a3e-531d-42ce-a877-70e0882eb4bf tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:25 devstack sudo[109274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4
Sep 28 18:31:25 devstack sudo[109274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:25 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-80f9e873-10d9-4697-ba60-048cca219c2d tempest-ProjectReaderTests-257558821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.bc1250bd-e089-4e67-a9ea-f97e1ebd84a9" returned: 0 in 0.473s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:25 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-80f9e873-10d9-4697-ba60-048cca219c2d tempest-ProjectReaderTests-257558821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4130921-37b8-41db-aa87-6a265af0e243(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:31:25 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e35611-6015-48ad-bc56-dbcce25f68de]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-80f9e873-10d9-4697-ba60-048cca219c2d tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:25 devstack sudo[109274]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d2536a3e-531d-42ce-a877-70e0882eb4bf tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-af306f5d-171e-4dfd-93db-fb5412c4fde4" returned: 0 in 0.323s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d2536a3e-531d-42ce-a877-70e0882eb4bf tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-af306f5d-171e-4dfd-93db-fb5412c4fde4" released by "delete_volume" :: held 0.842s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:25 devstack sudo[109282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243
Sep 28 18:31:25 devstack sudo[109282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:25 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-d2536a3e-531d-42ce-a877-70e0882eb4bf tempest-ProjectMemberTests-2016434849 None] Created reservations ['9010a933-f018-4324-a685-239ac47610bf', 'e892cd32-95d1-4770-81e2-78fbe3474603', '13b02517-e88e-4715-ab97-15d09fc55fdb', '48fe6a28-f3f7-46be-b1cf-8403c7b7057f'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d2536a3e-531d-42ce-a877-70e0882eb4bf tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d2536a3e-531d-42ce-a877-70e0882eb4bf tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:25 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d2536a3e-531d-42ce-a877-70e0882eb4bf tempest-ProjectMemberTests-2016434849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:25 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d2536a3e-531d-42ce-a877-70e0882eb4bf tempest-ProjectMemberTests-2016434849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d2536a3e-531d-42ce-a877-70e0882eb4bf tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d2536a3e-531d-42ce-a877-70e0882eb4bf tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:25 devstack sudo[109284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:31:25 devstack sudo[109284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:25 devstack sudo[109282]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-80f9e873-10d9-4697-ba60-048cca219c2d tempest-ProjectReaderTests-257558821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243" returned: 0 in 0.452s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-80f9e873-10d9-4697-ba60-048cca219c2d tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.bc1250bd-e089-4e67-a9ea-f97e1ebd84a9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:25 devstack sudo[109290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.bc1250bd-e089-4e67-a9ea-f97e1ebd84a9
Sep 28 18:31:25 devstack sudo[109290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:25 devstack sudo[109284]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:25 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d2536a3e-531d-42ce-a877-70e0882eb4bf tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.308s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:25 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d2536a3e-531d-42ce-a877-70e0882eb4bf tempest-ProjectMemberTests-2016434849 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:31:25 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d2536a3e-531d-42ce-a877-70e0882eb4bf tempest-ProjectMemberTests-2016434849 None] Deleted volume successfully.
Sep 28 18:31:25 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-d2536a3e-531d-42ce-a877-70e0882eb4bf tempest-ProjectMemberTests-2016434849 None] Lock "cinder-af306f5d-171e-4dfd-93db-fb5412c4fde4-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:26 devstack sudo[109290]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-80f9e873-10d9-4697-ba60-048cca219c2d tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.bc1250bd-e089-4e67-a9ea-f97e1ebd84a9" returned: 0 in 0.525s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-80f9e873-10d9-4697-ba60-048cca219c2d tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.bc1250bd-e089-4e67-a9ea-f97e1ebd84a9 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:31:26 devstack sudo[109297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.bc1250bd-e089-4e67-a9ea-f97e1ebd84a9
Sep 28 18:31:26 devstack sudo[109297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Flow 'volume_create_manager' (9c245aed-41ad-407a-8e5b-8ee7ec4d4ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480fa084-71a9-4e6f-9466-e7fedea3d00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480fa084-71a9-4e6f-9466-e7fedea3d00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2079492992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09df59f4-a176-41fd-bc9f-96e08f9ad70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7141bfada145467eb777f5e9601f614e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:26Z,use_quota=True,user_id='19ef54da5952457abebbe56a45760423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16cba54c-f849-4f06-a4e5-045c1fc0609e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16cba54c-f849-4f06-a4e5-045c1fc0609e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a5c2c15-bbdf-4fec-ae48-ed4aaacf6cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a5c2c15-bbdf-4fec-ae48-ed4aaacf6cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09df59f4-a176-41fd-bc9f-96e08f9ad70c', 'volume_name': 'volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d57fe587-949f-41a0-80d3-6900e802fcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d57fe587-949f-41a0-80d3-6900e802fcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b76e44-443d-43bd-9cd5-0d2bbf2535a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:26 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Volume 09df59f4-a176-41fd-bc9f-96e08f9ad70c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c', 'volume_size': 1}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2079492992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09df59f4-a176-41fd-bc9f-96e08f9ad70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7141bfada145467eb777f5e9601f614e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:26Z,use_quota=True,user_id='19ef54da5952457abebbe56a45760423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Creating volume 09df59f4-a176-41fd-bc9f-96e08f9ad70c {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:31:26 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:26 devstack sudo[109299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c 1073741824
Sep 28 18:31:26 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:26 devstack sudo[109297]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-80f9e873-10d9-4697-ba60-048cca219c2d tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243.bc1250bd-e089-4e67-a9ea-f97e1ebd84a9" returned: 0 in 0.317s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-80f9e873-10d9-4697-ba60-048cca219c2d tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-bc1250bd-e089-4e67-a9ea-f97e1ebd84a9" released by "_delete_snapshot" :: held 1.973s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-80f9e873-10d9-4697-ba60-048cca219c2d tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-b4130921-37b8-41db-aa87-6a265af0e243" released by "delete_snapshot" :: held 2.003s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-80f9e873-10d9-4697-ba60-048cca219c2d tempest-ProjectReaderTests-257558821 None] Created reservations ['60668b1e-0123-4303-bb4b-55dc21bc7149', '880e7676-aa15-47ce-a1ae-dc057133ce9f', '0686d101-4292-4326-b23a-fb1d2694ee4b', '0f27775f-f9e9-4229-9e98-c706ee7e1470'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:26 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-80f9e873-10d9-4697-ba60-048cca219c2d tempest-ProjectReaderTests-257558821 None] Delete snapshot completed successfully.
Sep 28 18:31:26 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-80f9e873-10d9-4697-ba60-048cca219c2d tempest-ProjectReaderTests-257558821 None] Lock "cinder-bc1250bd-e089-4e67-a9ea-f97e1ebd84a9-delete_snapshot" released by "delete_snapshot" :: held 2.233s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:27 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c 1073741824" returned: 0 in 0.618s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:27 devstack sudo[109306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c
Sep 28 18:31:27 devstack sudo[109306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:27 devstack sudo[109306]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c" returned: 0 in 0.247s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:27 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:31:27 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b76e44-443d-43bd-9cd5-0d2bbf2535a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a76439-1818-42c2-b7b7-fedcd6157ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:27 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Volume volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c (09df59f4-a176-41fd-bc9f-96e08f9ad70c): created successfully
Sep 28 18:31:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a76439-1818-42c2-b7b7-fedcd6157ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:27 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Flow 'volume_create_manager' (9c245aed-41ad-407a-8e5b-8ee7ec4d4ec6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:27 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-48a54e68-b0d9-40eb-b15e-ead586506980 tempest-ProjectMemberTests-2016434849 None] Created volume successfully.
Sep 28 18:31:27 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2aec7cd0-5423-49ea-a145-fd14162147bc tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-b4130921-37b8-41db-aa87-6a265af0e243-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:27 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2aec7cd0-5423-49ea-a145-fd14162147bc tempest-ProjectReaderTests-257558821 None] Lock "cinder-b4130921-37b8-41db-aa87-6a265af0e243-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:28 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2aec7cd0-5423-49ea-a145-fd14162147bc tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-quobyte-b4130921-37b8-41db-aa87-6a265af0e243" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:28 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2aec7cd0-5423-49ea-a145-fd14162147bc tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-b4130921-37b8-41db-aa87-6a265af0e243" acquired by "delete_volume" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:28 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb34ead-8fcb-429a-b641-eb0585697312]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2aec7cd0-5423-49ea-a145-fd14162147bc tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:28 devstack sudo[109309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243
Sep 28 18:31:28 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:28 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2aec7cd0-5423-49ea-a145-fd14162147bc tempest-ProjectReaderTests-257558821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243" returned: 0 in 0.468s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2aec7cd0-5423-49ea-a145-fd14162147bc tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:28 devstack sudo[109314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243
Sep 28 18:31:28 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-98fe4b18-b2bc-43bb-8ccf-95765be5508e tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-98fe4b18-b2bc-43bb-8ccf-95765be5508e tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:28 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-98fe4b18-b2bc-43bb-8ccf-95765be5508e tempest-ProjectMemberTests-2016434849 None] Creating offline snapshot f2796067-8088-4a32-8ea5-dde599fce4cb of volume 09df59f4-a176-41fd-bc9f-96e08f9ad70c {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:31:28 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c91401-43c3-4ca9-8aca-7f56d7696463]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-98fe4b18-b2bc-43bb-8ccf-95765be5508e tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:28 devstack sudo[109316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c
Sep 28 18:31:28 devstack sudo[109316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:28 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:28 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2aec7cd0-5423-49ea-a145-fd14162147bc tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-b4130921-37b8-41db-aa87-6a265af0e243" returned: 0 in 0.337s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:28 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2aec7cd0-5423-49ea-a145-fd14162147bc tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-b4130921-37b8-41db-aa87-6a265af0e243" released by "delete_volume" :: held 0.922s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:29 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-2aec7cd0-5423-49ea-a145-fd14162147bc tempest-ProjectReaderTests-257558821 None] Created reservations ['bb165fd1-2c64-4bc8-a1e1-c7a9f107e670', '8bee7399-3a07-46b4-8d64-9a165b9beaf4', '85e0decd-79e0-4bfd-9b31-66589cbc848e', 'a1920a4c-73ea-4c48-b331-e24a0da7395b'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2aec7cd0-5423-49ea-a145-fd14162147bc tempest-ProjectReaderTests-257558821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2aec7cd0-5423-49ea-a145-fd14162147bc tempest-ProjectReaderTests-257558821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2aec7cd0-5423-49ea-a145-fd14162147bc tempest-ProjectReaderTests-257558821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:29 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-2aec7cd0-5423-49ea-a145-fd14162147bc tempest-ProjectReaderTests-257558821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-2aec7cd0-5423-49ea-a145-fd14162147bc tempest-ProjectReaderTests-257558821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2aec7cd0-5423-49ea-a145-fd14162147bc tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:29 devstack sudo[109322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:31:29 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:29 devstack sudo[109316]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-98fe4b18-b2bc-43bb-8ccf-95765be5508e tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c" returned: 0 in 0.555s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-98fe4b18-b2bc-43bb-8ccf-95765be5508e tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.f2796067-8088-4a32-8ea5-dde599fce4cb 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:29 devstack sudo[109326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.f2796067-8088-4a32-8ea5-dde599fce4cb 1G
Sep 28 18:31:29 devstack sudo[109326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:29 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-2aec7cd0-5423-49ea-a145-fd14162147bc tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.272s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:29 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-2aec7cd0-5423-49ea-a145-fd14162147bc tempest-ProjectReaderTests-257558821 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:31:29 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-2aec7cd0-5423-49ea-a145-fd14162147bc tempest-ProjectReaderTests-257558821 None] Deleted volume successfully.
Sep 28 18:31:29 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-2aec7cd0-5423-49ea-a145-fd14162147bc tempest-ProjectReaderTests-257558821 None] Lock "cinder-b4130921-37b8-41db-aa87-6a265af0e243-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:29 devstack sudo[109326]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-98fe4b18-b2bc-43bb-8ccf-95765be5508e tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.f2796067-8088-4a32-8ea5-dde599fce4cb 1G" returned: 0 in 0.500s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:29 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-98fe4b18-b2bc-43bb-8ccf-95765be5508e tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.f2796067-8088-4a32-8ea5-dde599fce4cb {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:29 devstack sudo[109333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.f2796067-8088-4a32-8ea5-dde599fce4cb
Sep 28 18:31:29 devstack sudo[109333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:30 devstack sudo[109333]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-98fe4b18-b2bc-43bb-8ccf-95765be5508e tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.f2796067-8088-4a32-8ea5-dde599fce4cb" returned: 0 in 0.397s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:30 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-98fe4b18-b2bc-43bb-8ccf-95765be5508e tempest-ProjectMemberTests-2016434849 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.f2796067-8088-4a32-8ea5-dde599fce4cb is being set with open permissions: ugo+rw
Sep 28 18:31:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-98fe4b18-b2bc-43bb-8ccf-95765be5508e tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.f2796067-8088-4a32-8ea5-dde599fce4cb {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:30 devstack sudo[109338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.f2796067-8088-4a32-8ea5-dde599fce4cb
Sep 28 18:31:30 devstack sudo[109338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:30 devstack sudo[109338]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-98fe4b18-b2bc-43bb-8ccf-95765be5508e tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.f2796067-8088-4a32-8ea5-dde599fce4cb" returned: 0 in 0.293s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-98fe4b18-b2bc-43bb-8ccf-95765be5508e tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:30 devstack sudo[109341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.info
Sep 28 18:31:30 devstack sudo[109341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:30 devstack sudo[109341]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-98fe4b18-b2bc-43bb-8ccf-95765be5508e tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.info" returned: 0 in 0.322s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:30 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-98fe4b18-b2bc-43bb-8ccf-95765be5508e tempest-ProjectMemberTests-2016434849 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.info is being set with open permissions: ugo+rw
Sep 28 18:31:30 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-98fe4b18-b2bc-43bb-8ccf-95765be5508e tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:30 devstack sudo[109344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.info
Sep 28 18:31:30 devstack sudo[109344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:30 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:31:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Flow 'volume_create_manager' (9870ad1c-b81d-4ea0-a587-8577a150bac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:30 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a467ff-2851-44fa-8890-5fb5465036af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a467ff-2851-44fa-8890-5fb5465036af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-472197580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e38f645-b138-4e38-8b22-54d15be7fffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa1f17ecf644a9b93b4b4d10bad8593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:31Z,use_quota=True,user_id='215f54ccefe14730a0310f724f3df258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62acb9e5-7289-46fd-8100-1699e24feda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62acb9e5-7289-46fd-8100-1699e24feda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd36339-2bca-4fe8-8ad9-225c749dc4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd36339-2bca-4fe8-8ad9-225c749dc4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e38f645-b138-4e38-8b22-54d15be7fffc', 'volume_name': 'volume-5e38f645-b138-4e38-8b22-54d15be7fffc', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6285acb3-0eda-4bf7-bc30-c435e2885ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6285acb3-0eda-4bf7-bc30-c435e2885ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd54a86-72be-42ce-bae8-3780bbbf423e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:31 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Volume 5e38f645-b138-4e38-8b22-54d15be7fffc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e38f645-b138-4e38-8b22-54d15be7fffc', 'volume_size': 1}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:31 devstack sudo[109344]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-98fe4b18-b2bc-43bb-8ccf-95765be5508e tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.info" returned: 0 in 0.307s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-98fe4b18-b2bc-43bb-8ccf-95765be5508e tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.499s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.092s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-472197580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e38f645-b138-4e38-8b22-54d15be7fffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa1f17ecf644a9b93b4b4d10bad8593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:31Z,use_quota=True,user_id='215f54ccefe14730a0310f724f3df258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Creating volume 5e38f645-b138-4e38-8b22-54d15be7fffc {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:31:31 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:31 devstack sudo[109348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc 1073741824
Sep 28 18:31:31 devstack sudo[109348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:31 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-98fe4b18-b2bc-43bb-8ccf-95765be5508e tempest-ProjectMemberTests-2016434849 None] Create snapshot completed successfully
Sep 28 18:31:31 devstack sudo[109348]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc 1073741824" returned: 0 in 0.506s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:31 devstack sudo[109354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc
Sep 28 18:31:31 devstack sudo[109354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1630dd31-0834-48a0-986e-1cdd0bdef922 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-f2796067-8088-4a32-8ea5-dde599fce4cb-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1630dd31-0834-48a0-986e-1cdd0bdef922 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-f2796067-8088-4a32-8ea5-dde599fce4cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1630dd31-0834-48a0-986e-1cdd0bdef922 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-09df59f4-a176-41fd-bc9f-96e08f9ad70c" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1630dd31-0834-48a0-986e-1cdd0bdef922 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-09df59f4-a176-41fd-bc9f-96e08f9ad70c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1630dd31-0834-48a0-986e-1cdd0bdef922 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-f2796067-8088-4a32-8ea5-dde599fce4cb" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1630dd31-0834-48a0-986e-1cdd0bdef922 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-f2796067-8088-4a32-8ea5-dde599fce4cb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:31 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-1630dd31-0834-48a0-986e-1cdd0bdef922 tempest-ProjectMemberTests-2016434849 None] Deleting offline snapshot f2796067-8088-4a32-8ea5-dde599fce4cb of volume 09df59f4-a176-41fd-bc9f-96e08f9ad70c {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:31:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-1630dd31-0834-48a0-986e-1cdd0bdef922 tempest-ProjectMemberTests-2016434849 None] snapshot_file for this snap is: volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.f2796067-8088-4a32-8ea5-dde599fce4cb {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:31:32 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a019878c-102c-4b95-9a7a-d2137ec1a840]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1630dd31-0834-48a0-986e-1cdd0bdef922 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.f2796067-8088-4a32-8ea5-dde599fce4cb {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:32 devstack sudo[109354]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc" returned: 0 in 0.361s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:31:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd54a86-72be-42ce-bae8-3780bbbf423e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e38f645-b138-4e38-8b22-54d15be7fffc', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (239381b7-f442-4f0e-ab81-f1d073ab90f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:32 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Volume volume-5e38f645-b138-4e38-8b22-54d15be7fffc (5e38f645-b138-4e38-8b22-54d15be7fffc): created successfully
Sep 28 18:31:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (239381b7-f442-4f0e-ab81-f1d073ab90f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:32 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Flow 'volume_create_manager' (9870ad1c-b81d-4ea0-a587-8577a150bac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:32 devstack sudo[109357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.f2796067-8088-4a32-8ea5-dde599fce4cb
Sep 28 18:31:32 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:32 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-375663ad-9dfd-4fda-a4b8-4e63679186dd tempest-ProjectReaderTests-257558821 None] Created volume successfully.
Sep 28 18:31:32 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1630dd31-0834-48a0-986e-1cdd0bdef922 tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.f2796067-8088-4a32-8ea5-dde599fce4cb" returned: 0 in 0.500s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:32 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-1630dd31-0834-48a0-986e-1cdd0bdef922 tempest-ProjectMemberTests-2016434849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:31:32 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[115da3cc-d1dd-4fd5-ba42-f16a5cbb41fa]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:32 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1630dd31-0834-48a0-986e-1cdd0bdef922 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:32 devstack sudo[109362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c
Sep 28 18:31:32 devstack sudo[109362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:33 devstack sudo[109362]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1630dd31-0834-48a0-986e-1cdd0bdef922 tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c" returned: 0 in 0.466s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1630dd31-0834-48a0-986e-1cdd0bdef922 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.f2796067-8088-4a32-8ea5-dde599fce4cb {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:33 devstack sudo[109367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.f2796067-8088-4a32-8ea5-dde599fce4cb
Sep 28 18:31:33 devstack sudo[109367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-01d44e6b-3be4-442a-b2dc-1652ddad3c9e tempest-ProjectReaderTests-257558821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-01d44e6b-3be4-442a-b2dc-1652ddad3c9e tempest-ProjectReaderTests-257558821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:33 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-01d44e6b-3be4-442a-b2dc-1652ddad3c9e tempest-ProjectReaderTests-257558821 None] Creating offline snapshot 4ec7218b-d99b-4e61-9ef3-c3a4b614e028 of volume 5e38f645-b138-4e38-8b22-54d15be7fffc {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:31:33 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a738d0b-ed90-486e-9fd7-14cf29775318]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01d44e6b-3be4-442a-b2dc-1652ddad3c9e tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:33 devstack sudo[109371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc
Sep 28 18:31:33 devstack sudo[109371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:33 devstack sudo[109367]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1630dd31-0834-48a0-986e-1cdd0bdef922 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.f2796067-8088-4a32-8ea5-dde599fce4cb" returned: 0 in 0.591s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1630dd31-0834-48a0-986e-1cdd0bdef922 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.f2796067-8088-4a32-8ea5-dde599fce4cb {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:33 devstack sudo[109375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.f2796067-8088-4a32-8ea5-dde599fce4cb
Sep 28 18:31:33 devstack sudo[109375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:33 devstack sudo[109371]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01d44e6b-3be4-442a-b2dc-1652ddad3c9e tempest-ProjectReaderTests-257558821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc" returned: 0 in 0.514s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01d44e6b-3be4-442a-b2dc-1652ddad3c9e tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.4ec7218b-d99b-4e61-9ef3-c3a4b614e028 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:33 devstack sudo[109380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.4ec7218b-d99b-4e61-9ef3-c3a4b614e028 1G
Sep 28 18:31:33 devstack sudo[109380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:33 devstack sudo[109375]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:33 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-1630dd31-0834-48a0-986e-1cdd0bdef922 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c.f2796067-8088-4a32-8ea5-dde599fce4cb" returned: 0 in 0.308s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:34 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1630dd31-0834-48a0-986e-1cdd0bdef922 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-f2796067-8088-4a32-8ea5-dde599fce4cb" released by "_delete_snapshot" :: held 2.039s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:34 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1630dd31-0834-48a0-986e-1cdd0bdef922 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-09df59f4-a176-41fd-bc9f-96e08f9ad70c" released by "delete_snapshot" :: held 2.073s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:34 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-1630dd31-0834-48a0-986e-1cdd0bdef922 tempest-ProjectMemberTests-2016434849 None] Created reservations ['ac633ac2-e901-4e7e-af86-252e80628c21', '9193140a-2df6-46a6-91af-bad77c96d9cb', '27bca66e-6a73-48ad-ae94-71c0e437ea7b', '6045314b-ee99-48db-85b8-6b6362230499'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:34 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-1630dd31-0834-48a0-986e-1cdd0bdef922 tempest-ProjectMemberTests-2016434849 None] Delete snapshot completed successfully.
Sep 28 18:31:34 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-1630dd31-0834-48a0-986e-1cdd0bdef922 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-f2796067-8088-4a32-8ea5-dde599fce4cb-delete_snapshot" released by "delete_snapshot" :: held 2.314s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:34 devstack sudo[109380]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01d44e6b-3be4-442a-b2dc-1652ddad3c9e tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.4ec7218b-d99b-4e61-9ef3-c3a4b614e028 1G" returned: 0 in 0.576s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01d44e6b-3be4-442a-b2dc-1652ddad3c9e tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e38f645-b138-4e38-8b22-54d15be7fffc -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.4ec7218b-d99b-4e61-9ef3-c3a4b614e028 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:34 devstack sudo[109387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e38f645-b138-4e38-8b22-54d15be7fffc -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.4ec7218b-d99b-4e61-9ef3-c3a4b614e028
Sep 28 18:31:34 devstack sudo[109387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:34 devstack sudo[109387]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01d44e6b-3be4-442a-b2dc-1652ddad3c9e tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e38f645-b138-4e38-8b22-54d15be7fffc -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.4ec7218b-d99b-4e61-9ef3-c3a4b614e028" returned: 0 in 0.383s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:34 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-01d44e6b-3be4-442a-b2dc-1652ddad3c9e tempest-ProjectReaderTests-257558821 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.4ec7218b-d99b-4e61-9ef3-c3a4b614e028 is being set with open permissions: ugo+rw
Sep 28 18:31:34 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01d44e6b-3be4-442a-b2dc-1652ddad3c9e tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.4ec7218b-d99b-4e61-9ef3-c3a4b614e028 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:34 devstack sudo[109393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.4ec7218b-d99b-4e61-9ef3-c3a4b614e028
Sep 28 18:31:34 devstack sudo[109393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:35 devstack sudo[109393]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01d44e6b-3be4-442a-b2dc-1652ddad3c9e tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.4ec7218b-d99b-4e61-9ef3-c3a4b614e028" returned: 0 in 0.304s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01d44e6b-3be4-442a-b2dc-1652ddad3c9e tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-85af4a30-0100-4332-baa7-911bcd7c6f46 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-09df59f4-a176-41fd-bc9f-96e08f9ad70c-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:35 devstack sudo[109396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.info
Sep 28 18:31:35 devstack sudo[109396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-85af4a30-0100-4332-baa7-911bcd7c6f46 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-09df59f4-a176-41fd-bc9f-96e08f9ad70c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-85af4a30-0100-4332-baa7-911bcd7c6f46 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-09df59f4-a176-41fd-bc9f-96e08f9ad70c" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:35 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-85af4a30-0100-4332-baa7-911bcd7c6f46 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-09df59f4-a176-41fd-bc9f-96e08f9ad70c" acquired by "delete_volume" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:35 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dbf1f4-830a-4a1f-ab6b-4e77988bed3e]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-85af4a30-0100-4332-baa7-911bcd7c6f46 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:35 devstack sudo[109398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c
Sep 28 18:31:35 devstack sudo[109398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:35 devstack sudo[109396]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01d44e6b-3be4-442a-b2dc-1652ddad3c9e tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.info" returned: 0 in 0.374s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:35 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-01d44e6b-3be4-442a-b2dc-1652ddad3c9e tempest-ProjectReaderTests-257558821 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.info is being set with open permissions: ugo+rw
Sep 28 18:31:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01d44e6b-3be4-442a-b2dc-1652ddad3c9e tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:35 devstack sudo[109401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.info
Sep 28 18:31:35 devstack sudo[109401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:35 devstack sudo[109398]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-85af4a30-0100-4332-baa7-911bcd7c6f46 tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c" returned: 0 in 0.447s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-85af4a30-0100-4332-baa7-911bcd7c6f46 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:35 devstack sudo[109401]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-01d44e6b-3be4-442a-b2dc-1652ddad3c9e tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.info" returned: 0 in 0.324s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:35 devstack sudo[109407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c
Sep 28 18:31:35 devstack sudo[109407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:35 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-01d44e6b-3be4-442a-b2dc-1652ddad3c9e tempest-ProjectReaderTests-257558821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.591s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:35 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-01d44e6b-3be4-442a-b2dc-1652ddad3c9e tempest-ProjectReaderTests-257558821 None] Create snapshot completed successfully
Sep 28 18:31:36 devstack sudo[109407]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-85af4a30-0100-4332-baa7-911bcd7c6f46 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-09df59f4-a176-41fd-bc9f-96e08f9ad70c" returned: 0 in 0.304s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-85af4a30-0100-4332-baa7-911bcd7c6f46 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-09df59f4-a176-41fd-bc9f-96e08f9ad70c" released by "delete_volume" :: held 0.883s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:36 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-85af4a30-0100-4332-baa7-911bcd7c6f46 tempest-ProjectMemberTests-2016434849 None] Created reservations ['e9fe08f9-d9a6-4201-ae37-e44a274d0bc4', '63a0e34a-5a74-4954-9b9e-5a0b829a4420', '554894bb-7f59-4207-b926-a7cafa830087', 'd74c9425-9a7a-4846-8a6b-6741c315b13f'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-85af4a30-0100-4332-baa7-911bcd7c6f46 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-85af4a30-0100-4332-baa7-911bcd7c6f46 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-85af4a30-0100-4332-baa7-911bcd7c6f46 tempest-ProjectMemberTests-2016434849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-85af4a30-0100-4332-baa7-911bcd7c6f46 tempest-ProjectMemberTests-2016434849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-85af4a30-0100-4332-baa7-911bcd7c6f46 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-85af4a30-0100-4332-baa7-911bcd7c6f46 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:36 devstack sudo[109410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:31:36 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-eed5f259-0e49-4c0e-8b21-f51275ed6a2a tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-4ec7218b-d99b-4e61-9ef3-c3a4b614e028-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-eed5f259-0e49-4c0e-8b21-f51275ed6a2a tempest-ProjectReaderTests-257558821 None] Lock "cinder-4ec7218b-d99b-4e61-9ef3-c3a4b614e028-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-eed5f259-0e49-4c0e-8b21-f51275ed6a2a tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-quobyte-5e38f645-b138-4e38-8b22-54d15be7fffc" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-eed5f259-0e49-4c0e-8b21-f51275ed6a2a tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-5e38f645-b138-4e38-8b22-54d15be7fffc" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-eed5f259-0e49-4c0e-8b21-f51275ed6a2a tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-quobyte-4ec7218b-d99b-4e61-9ef3-c3a4b614e028" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-eed5f259-0e49-4c0e-8b21-f51275ed6a2a tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-4ec7218b-d99b-4e61-9ef3-c3a4b614e028" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-eed5f259-0e49-4c0e-8b21-f51275ed6a2a tempest-ProjectReaderTests-257558821 None] Deleting offline snapshot 4ec7218b-d99b-4e61-9ef3-c3a4b614e028 of volume 5e38f645-b138-4e38-8b22-54d15be7fffc {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:31:36 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-eed5f259-0e49-4c0e-8b21-f51275ed6a2a tempest-ProjectReaderTests-257558821 None] snapshot_file for this snap is: volume-5e38f645-b138-4e38-8b22-54d15be7fffc.4ec7218b-d99b-4e61-9ef3-c3a4b614e028 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:31:36 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a16007-ca84-47b6-b1fc-da62d9dfd034]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-eed5f259-0e49-4c0e-8b21-f51275ed6a2a tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.4ec7218b-d99b-4e61-9ef3-c3a4b614e028 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:36 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:36 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-85af4a30-0100-4332-baa7-911bcd7c6f46 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.511s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:36 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-85af4a30-0100-4332-baa7-911bcd7c6f46 tempest-ProjectMemberTests-2016434849 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:31:36 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-85af4a30-0100-4332-baa7-911bcd7c6f46 tempest-ProjectMemberTests-2016434849 None] Deleted volume successfully.
Sep 28 18:31:36 devstack sudo[109447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.4ec7218b-d99b-4e61-9ef3-c3a4b614e028
Sep 28 18:31:36 devstack sudo[109447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:36 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-85af4a30-0100-4332-baa7-911bcd7c6f46 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-09df59f4-a176-41fd-bc9f-96e08f9ad70c-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Flow 'volume_create_manager' (7ccb3a8a-8457-40d0-b291-6f648c8816f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7660ad6a-ee5a-435a-95d6-49233e2b2629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7660ad6a-ee5a-435a-95d6-49233e2b2629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-677426720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63dec837-f776-46c5-aec5-5fe785540d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7141bfada145467eb777f5e9601f614e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:37Z,use_quota=True,user_id='19ef54da5952457abebbe56a45760423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac13309-da72-4a67-b820-23ef0d67094c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac13309-da72-4a67-b820-23ef0d67094c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c348cb-5798-456b-8ba9-34eac24881c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c348cb-5798-456b-8ba9-34eac24881c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63dec837-f776-46c5-aec5-5fe785540d7e', 'volume_name': 'volume-63dec837-f776-46c5-aec5-5fe785540d7e', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f4b0bd-d0fa-4a27-8e27-3f0a836f4e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f4b0bd-d0fa-4a27-8e27-3f0a836f4e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7460fbfa-88f8-437e-96a8-a327904d2f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:37 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Volume 63dec837-f776-46c5-aec5-5fe785540d7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63dec837-f776-46c5-aec5-5fe785540d7e', 'volume_size': 1}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-677426720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63dec837-f776-46c5-aec5-5fe785540d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7141bfada145467eb777f5e9601f614e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:37Z,use_quota=True,user_id='19ef54da5952457abebbe56a45760423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Creating volume 63dec837-f776-46c5-aec5-5fe785540d7e {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:31:37 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:37 devstack sudo[109453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e 1073741824
Sep 28 18:31:37 devstack sudo[109453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:37 devstack sudo[109447]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-eed5f259-0e49-4c0e-8b21-f51275ed6a2a tempest-ProjectReaderTests-257558821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.4ec7218b-d99b-4e61-9ef3-c3a4b614e028" returned: 0 in 0.610s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-eed5f259-0e49-4c0e-8b21-f51275ed6a2a tempest-ProjectReaderTests-257558821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e38f645-b138-4e38-8b22-54d15be7fffc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[869094bd-8f60-43fd-b498-29c91a5e37ce]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-eed5f259-0e49-4c0e-8b21-f51275ed6a2a tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:37 devstack sudo[109457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc
Sep 28 18:31:37 devstack sudo[109457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:37 devstack sudo[109453]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e 1073741824" returned: 0 in 0.556s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:37 devstack sudo[109466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e
Sep 28 18:31:37 devstack sudo[109466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:37 devstack sudo[109457]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-eed5f259-0e49-4c0e-8b21-f51275ed6a2a tempest-ProjectReaderTests-257558821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc" returned: 0 in 0.511s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:37 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-eed5f259-0e49-4c0e-8b21-f51275ed6a2a tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.4ec7218b-d99b-4e61-9ef3-c3a4b614e028 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:37 devstack sudo[109468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.4ec7218b-d99b-4e61-9ef3-c3a4b614e028
Sep 28 18:31:37 devstack sudo[109468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:38 devstack sudo[109466]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e" returned: 0 in 0.299s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:38 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:31:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7460fbfa-88f8-437e-96a8-a327904d2f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63dec837-f776-46c5-aec5-5fe785540d7e', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6d7cd8d-ed01-49cf-999e-e92239dd2da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:38 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Volume volume-63dec837-f776-46c5-aec5-5fe785540d7e (63dec837-f776-46c5-aec5-5fe785540d7e): created successfully
Sep 28 18:31:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6d7cd8d-ed01-49cf-999e-e92239dd2da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:38 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Flow 'volume_create_manager' (7ccb3a8a-8457-40d0-b291-6f648c8816f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:38 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-9275a799-3d91-4290-95e0-2c6ab010ef6d tempest-ProjectMemberTests-2016434849 None] Created volume successfully.
Sep 28 18:31:38 devstack sudo[109468]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-eed5f259-0e49-4c0e-8b21-f51275ed6a2a tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.4ec7218b-d99b-4e61-9ef3-c3a4b614e028" returned: 0 in 0.356s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-eed5f259-0e49-4c0e-8b21-f51275ed6a2a tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.4ec7218b-d99b-4e61-9ef3-c3a4b614e028 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:38 devstack sudo[109474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.4ec7218b-d99b-4e61-9ef3-c3a4b614e028
Sep 28 18:31:38 devstack sudo[109474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:38 devstack sudo[109474]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:38 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-eed5f259-0e49-4c0e-8b21-f51275ed6a2a tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc.4ec7218b-d99b-4e61-9ef3-c3a4b614e028" returned: 0 in 0.243s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-eed5f259-0e49-4c0e-8b21-f51275ed6a2a tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-4ec7218b-d99b-4e61-9ef3-c3a4b614e028" released by "_delete_snapshot" :: held 1.920s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-eed5f259-0e49-4c0e-8b21-f51275ed6a2a tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-5e38f645-b138-4e38-8b22-54d15be7fffc" released by "delete_snapshot" :: held 1.949s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:38 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-eed5f259-0e49-4c0e-8b21-f51275ed6a2a tempest-ProjectReaderTests-257558821 None] Created reservations ['101833f5-36c5-4c25-8a87-4dbc4d3844a3', '01cada44-b5bd-4a21-868c-8e5c75b395ea', '9a9c33f5-3025-4bb9-bc56-99b13daaa1bb', '2bc8198e-4ce5-464c-b445-120e49cddc47'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:38 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-eed5f259-0e49-4c0e-8b21-f51275ed6a2a tempest-ProjectReaderTests-257558821 None] Delete snapshot completed successfully.
Sep 28 18:31:38 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-eed5f259-0e49-4c0e-8b21-f51275ed6a2a tempest-ProjectReaderTests-257558821 None] Lock "cinder-4ec7218b-d99b-4e61-9ef3-c3a4b614e028-delete_snapshot" released by "delete_snapshot" :: held 2.109s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6cf4d167-38f4-48f1-b2ae-af231c679165 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6cf4d167-38f4-48f1-b2ae-af231c679165 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:39 devstack sudo[109477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:31:39 devstack sudo[109477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-6cf4d167-38f4-48f1-b2ae-af231c679165 tempest-ProjectMemberTests-2016434849 None] Creating offline snapshot 35a3c904-ec98-4bcc-9f00-abe2023d8103 of volume 63dec837-f776-46c5-aec5-5fe785540d7e {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[134e40cb-0429-494f-8875-3dbf162f7b7b]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cf4d167-38f4-48f1-b2ae-af231c679165 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:39 devstack sudo[109479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e
Sep 28 18:31:39 devstack sudo[109479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:39 devstack sudo[109477]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e26af328-05a5-449a-ab3a-b33423a9e08d tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-5e38f645-b138-4e38-8b22-54d15be7fffc-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.325s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e26af328-05a5-449a-ab3a-b33423a9e08d tempest-ProjectReaderTests-257558821 None] Lock "cinder-5e38f645-b138-4e38-8b22-54d15be7fffc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e26af328-05a5-449a-ab3a-b33423a9e08d tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-quobyte-5e38f645-b138-4e38-8b22-54d15be7fffc" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e26af328-05a5-449a-ab3a-b33423a9e08d tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-5e38f645-b138-4e38-8b22-54d15be7fffc" acquired by "delete_volume" :: waited 0.017s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[398a0386-c7d8-4dc5-acf2-4390a7505b3f]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e26af328-05a5-449a-ab3a-b33423a9e08d tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:39 devstack sudo[109479]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cf4d167-38f4-48f1-b2ae-af231c679165 tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e" returned: 0 in 0.469s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cf4d167-38f4-48f1-b2ae-af231c679165 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.35a3c904-ec98-4bcc-9f00-abe2023d8103 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:40 devstack sudo[109486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.35a3c904-ec98-4bcc-9f00-abe2023d8103 1G
Sep 28 18:31:40 devstack sudo[109486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:40 devstack sudo[109485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc
Sep 28 18:31:40 devstack sudo[109485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:40 devstack sudo[109485]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e26af328-05a5-449a-ab3a-b33423a9e08d tempest-ProjectReaderTests-257558821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc" returned: 0 in 0.456s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e26af328-05a5-449a-ab3a-b33423a9e08d tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:40 devstack sudo[109495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc
Sep 28 18:31:40 devstack sudo[109495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:40 devstack sudo[109486]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cf4d167-38f4-48f1-b2ae-af231c679165 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.35a3c904-ec98-4bcc-9f00-abe2023d8103 1G" returned: 0 in 0.481s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cf4d167-38f4-48f1-b2ae-af231c679165 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63dec837-f776-46c5-aec5-5fe785540d7e -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.35a3c904-ec98-4bcc-9f00-abe2023d8103 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:40 devstack sudo[109503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63dec837-f776-46c5-aec5-5fe785540d7e -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.35a3c904-ec98-4bcc-9f00-abe2023d8103
Sep 28 18:31:40 devstack sudo[109503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:40 devstack sudo[109495]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e26af328-05a5-449a-ab3a-b33423a9e08d tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5e38f645-b138-4e38-8b22-54d15be7fffc" returned: 0 in 0.276s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:40 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e26af328-05a5-449a-ab3a-b33423a9e08d tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-5e38f645-b138-4e38-8b22-54d15be7fffc" released by "delete_volume" :: held 0.818s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:40 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-e26af328-05a5-449a-ab3a-b33423a9e08d tempest-ProjectReaderTests-257558821 None] Created reservations ['6699c4c4-40db-4f7f-ba6c-8d2bf7089e9f', '087b237b-3024-4836-930e-28177ad23563', 'bb9f63df-21a7-4398-8324-12ac20989801', 'e78850ef-9d00-463e-bdb5-f0baf42a9ce1'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:40 devstack sudo[109503]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cf4d167-38f4-48f1-b2ae-af231c679165 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63dec837-f776-46c5-aec5-5fe785540d7e -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.35a3c904-ec98-4bcc-9f00-abe2023d8103" returned: 0 in 0.377s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:40 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-6cf4d167-38f4-48f1-b2ae-af231c679165 tempest-ProjectMemberTests-2016434849 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.35a3c904-ec98-4bcc-9f00-abe2023d8103 is being set with open permissions: ugo+rw
Sep 28 18:31:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cf4d167-38f4-48f1-b2ae-af231c679165 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.35a3c904-ec98-4bcc-9f00-abe2023d8103 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e26af328-05a5-449a-ab3a-b33423a9e08d tempest-ProjectReaderTests-257558821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e26af328-05a5-449a-ab3a-b33423a9e08d tempest-ProjectReaderTests-257558821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e26af328-05a5-449a-ab3a-b33423a9e08d tempest-ProjectReaderTests-257558821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:40 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-e26af328-05a5-449a-ab3a-b33423a9e08d tempest-ProjectReaderTests-257558821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-e26af328-05a5-449a-ab3a-b33423a9e08d tempest-ProjectReaderTests-257558821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:40 devstack sudo[109510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.35a3c904-ec98-4bcc-9f00-abe2023d8103
Sep 28 18:31:40 devstack sudo[109510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:40 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e26af328-05a5-449a-ab3a-b33423a9e08d tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:40 devstack sudo[109512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:31:40 devstack sudo[109512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:41 devstack sudo[109510]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cf4d167-38f4-48f1-b2ae-af231c679165 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.35a3c904-ec98-4bcc-9f00-abe2023d8103" returned: 0 in 0.295s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:41 devstack sudo[109512]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cf4d167-38f4-48f1-b2ae-af231c679165 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-e26af328-05a5-449a-ab3a-b33423a9e08d tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.314s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-e26af328-05a5-449a-ab3a-b33423a9e08d tempest-ProjectReaderTests-257558821 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:31:41 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-e26af328-05a5-449a-ab3a-b33423a9e08d tempest-ProjectReaderTests-257558821 None] Deleted volume successfully.
Sep 28 18:31:41 devstack sudo[109516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.info
Sep 28 18:31:41 devstack sudo[109516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-e26af328-05a5-449a-ab3a-b33423a9e08d tempest-ProjectReaderTests-257558821 None] Lock "cinder-5e38f645-b138-4e38-8b22-54d15be7fffc-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:41 devstack sudo[109516]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cf4d167-38f4-48f1-b2ae-af231c679165 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.info" returned: 0 in 0.316s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:41 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-6cf4d167-38f4-48f1-b2ae-af231c679165 tempest-ProjectMemberTests-2016434849 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.info is being set with open permissions: ugo+rw
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cf4d167-38f4-48f1-b2ae-af231c679165 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:41 devstack sudo[109519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.info
Sep 28 18:31:41 devstack sudo[109519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Flow 'volume_create_manager' (0e6dcf04-912d-420d-b1c6-5d13c7be8742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122ab8f3-4422-4632-b5b2-b0e34b33f391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122ab8f3-4422-4632-b5b2-b0e34b33f391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-355478317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a02b6f5-473e-4275-a306-1f8889ff8736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa1f17ecf644a9b93b4b4d10bad8593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:41Z,use_quota=True,user_id='215f54ccefe14730a0310f724f3df258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76bde9a-ae25-44fa-b01d-0b591e5d9dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76bde9a-ae25-44fa-b01d-0b591e5d9dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a448a6-31f2-42ea-ab63-b25e17b874b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a448a6-31f2-42ea-ab63-b25e17b874b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a02b6f5-473e-4275-a306-1f8889ff8736', 'volume_name': 'volume-0a02b6f5-473e-4275-a306-1f8889ff8736', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67bd5b74-90a3-440c-a30e-001eef7e3989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67bd5b74-90a3-440c-a30e-001eef7e3989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d53b9928-605c-4fc2-bab2-42bdff6e1ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:41 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Volume 0a02b6f5-473e-4275-a306-1f8889ff8736: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a02b6f5-473e-4275-a306-1f8889ff8736', 'volume_size': 1}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:41 devstack sudo[109519]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6cf4d167-38f4-48f1-b2ae-af231c679165 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.info" returned: 0 in 0.243s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6cf4d167-38f4-48f1-b2ae-af231c679165 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.294s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.128s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-355478317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a02b6f5-473e-4275-a306-1f8889ff8736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa1f17ecf644a9b93b4b4d10bad8593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:41Z,use_quota=True,user_id='215f54ccefe14730a0310f724f3df258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Creating volume 0a02b6f5-473e-4275-a306-1f8889ff8736 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:31:41 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:31:41 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:41 devstack sudo[109522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736 1073741824
Sep 28 18:31:41 devstack sudo[109522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:41 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-6cf4d167-38f4-48f1-b2ae-af231c679165 tempest-ProjectMemberTests-2016434849 None] Create snapshot completed successfully
Sep 28 18:31:42 devstack sudo[109522]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736 1073741824" returned: 0 in 0.448s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:42 devstack sudo[109527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736
Sep 28 18:31:42 devstack sudo[109527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:42 devstack sudo[109527]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736" returned: 0 in 0.290s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:31:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d53b9928-605c-4fc2-bab2-42bdff6e1ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a02b6f5-473e-4275-a306-1f8889ff8736', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57dc6cde-73cf-4389-8548-12ead1b5fb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:42 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Volume volume-0a02b6f5-473e-4275-a306-1f8889ff8736 (0a02b6f5-473e-4275-a306-1f8889ff8736): created successfully
Sep 28 18:31:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57dc6cde-73cf-4389-8548-12ead1b5fb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:42 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Flow 'volume_create_manager' (0e6dcf04-912d-420d-b1c6-5d13c7be8742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5af9c493-57ce-4df1-a885-ba7840feb05a tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-35a3c904-ec98-4bcc-9f00-abe2023d8103-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:42 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-71031841-e993-4d4a-a77e-bac7944ace5c tempest-ProjectReaderTests-257558821 None] Created volume successfully.
Sep 28 18:31:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5af9c493-57ce-4df1-a885-ba7840feb05a tempest-ProjectMemberTests-2016434849 None] Lock "cinder-35a3c904-ec98-4bcc-9f00-abe2023d8103-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5af9c493-57ce-4df1-a885-ba7840feb05a tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-63dec837-f776-46c5-aec5-5fe785540d7e" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5af9c493-57ce-4df1-a885-ba7840feb05a tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-63dec837-f776-46c5-aec5-5fe785540d7e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5af9c493-57ce-4df1-a885-ba7840feb05a tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-35a3c904-ec98-4bcc-9f00-abe2023d8103" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:42 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5af9c493-57ce-4df1-a885-ba7840feb05a tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-35a3c904-ec98-4bcc-9f00-abe2023d8103" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-5af9c493-57ce-4df1-a885-ba7840feb05a tempest-ProjectMemberTests-2016434849 None] Deleting offline snapshot 35a3c904-ec98-4bcc-9f00-abe2023d8103 of volume 63dec837-f776-46c5-aec5-5fe785540d7e {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:31:42 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-5af9c493-57ce-4df1-a885-ba7840feb05a tempest-ProjectMemberTests-2016434849 None] snapshot_file for this snap is: volume-63dec837-f776-46c5-aec5-5fe785540d7e.35a3c904-ec98-4bcc-9f00-abe2023d8103 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:31:42 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[befb2e9b-2f7e-4d8d-940c-69044543d6b4]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:42 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5af9c493-57ce-4df1-a885-ba7840feb05a tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.35a3c904-ec98-4bcc-9f00-abe2023d8103 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:42 devstack sudo[109530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.35a3c904-ec98-4bcc-9f00-abe2023d8103
Sep 28 18:31:42 devstack sudo[109530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:43 devstack sudo[109530]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5af9c493-57ce-4df1-a885-ba7840feb05a tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.35a3c904-ec98-4bcc-9f00-abe2023d8103" returned: 0 in 0.382s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-5af9c493-57ce-4df1-a885-ba7840feb05a tempest-ProjectMemberTests-2016434849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63dec837-f776-46c5-aec5-5fe785540d7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:31:43 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04a151c-df5c-4fe8-b263-a151179b8a2b]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5af9c493-57ce-4df1-a885-ba7840feb05a tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:43 devstack sudo[109535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e
Sep 28 18:31:43 devstack sudo[109535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:43 devstack sudo[109535]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5af9c493-57ce-4df1-a885-ba7840feb05a tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e" returned: 0 in 0.375s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5af9c493-57ce-4df1-a885-ba7840feb05a tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.35a3c904-ec98-4bcc-9f00-abe2023d8103 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:43 devstack sudo[109541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.35a3c904-ec98-4bcc-9f00-abe2023d8103
Sep 28 18:31:43 devstack sudo[109541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-46f33a50-0ad2-4475-8041-1ef412971349 tempest-ProjectReaderTests-257558821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-46f33a50-0ad2-4475-8041-1ef412971349 tempest-ProjectReaderTests-257558821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:43 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-46f33a50-0ad2-4475-8041-1ef412971349 tempest-ProjectReaderTests-257558821 None] Creating offline snapshot a82a545f-d384-4a23-89cb-81e3213daefd of volume 0a02b6f5-473e-4275-a306-1f8889ff8736 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:31:43 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b5e56d-c5aa-437c-82e0-402211db09b7]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46f33a50-0ad2-4475-8041-1ef412971349 tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:43 devstack sudo[109541]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5af9c493-57ce-4df1-a885-ba7840feb05a tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.35a3c904-ec98-4bcc-9f00-abe2023d8103" returned: 0 in 0.417s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:43 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5af9c493-57ce-4df1-a885-ba7840feb05a tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.35a3c904-ec98-4bcc-9f00-abe2023d8103 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:43 devstack sudo[109547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.35a3c904-ec98-4bcc-9f00-abe2023d8103
Sep 28 18:31:43 devstack sudo[109547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:44 devstack sudo[109546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736
Sep 28 18:31:44 devstack sudo[109546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:44 devstack sudo[109547]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5af9c493-57ce-4df1-a885-ba7840feb05a tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e.35a3c904-ec98-4bcc-9f00-abe2023d8103" returned: 0 in 0.301s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5af9c493-57ce-4df1-a885-ba7840feb05a tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-35a3c904-ec98-4bcc-9f00-abe2023d8103" released by "_delete_snapshot" :: held 1.581s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5af9c493-57ce-4df1-a885-ba7840feb05a tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-63dec837-f776-46c5-aec5-5fe785540d7e" released by "delete_snapshot" :: held 1.603s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:44 devstack sudo[109546]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46f33a50-0ad2-4475-8041-1ef412971349 tempest-ProjectReaderTests-257558821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736" returned: 0 in 0.440s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46f33a50-0ad2-4475-8041-1ef412971349 tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.a82a545f-d384-4a23-89cb-81e3213daefd 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:44 devstack sudo[109554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.a82a545f-d384-4a23-89cb-81e3213daefd 1G
Sep 28 18:31:44 devstack sudo[109554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:44 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-5af9c493-57ce-4df1-a885-ba7840feb05a tempest-ProjectMemberTests-2016434849 None] Created reservations ['d51f9be9-59b1-4788-9803-8ac014400ac8', 'd1a3ea05-1753-4267-8e7e-40f28f9c8c5f', '2fb78b5a-13e3-4344-b330-9f8f1f48a627', '936a608c-da19-4c8c-a152-4d3a6b46bd38'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:44 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-5af9c493-57ce-4df1-a885-ba7840feb05a tempest-ProjectMemberTests-2016434849 None] Delete snapshot completed successfully.
Sep 28 18:31:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5af9c493-57ce-4df1-a885-ba7840feb05a tempest-ProjectMemberTests-2016434849 None] Lock "cinder-35a3c904-ec98-4bcc-9f00-abe2023d8103-delete_snapshot" released by "delete_snapshot" :: held 1.784s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:44 devstack sudo[109554]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46f33a50-0ad2-4475-8041-1ef412971349 tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.a82a545f-d384-4a23-89cb-81e3213daefd 1G" returned: 0 in 0.485s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:44 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46f33a50-0ad2-4475-8041-1ef412971349 tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a02b6f5-473e-4275-a306-1f8889ff8736 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.a82a545f-d384-4a23-89cb-81e3213daefd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:44 devstack sudo[109560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a02b6f5-473e-4275-a306-1f8889ff8736 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.a82a545f-d384-4a23-89cb-81e3213daefd
Sep 28 18:31:44 devstack sudo[109560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:44 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6c8f32d1-3535-4293-82b0-34aede3f48af tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-63dec837-f776-46c5-aec5-5fe785540d7e-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6c8f32d1-3535-4293-82b0-34aede3f48af tempest-ProjectMemberTests-2016434849 None] Lock "cinder-63dec837-f776-46c5-aec5-5fe785540d7e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6c8f32d1-3535-4293-82b0-34aede3f48af tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-63dec837-f776-46c5-aec5-5fe785540d7e" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6c8f32d1-3535-4293-82b0-34aede3f48af tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-63dec837-f776-46c5-aec5-5fe785540d7e" acquired by "delete_volume" :: waited 0.021s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:45 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d396f2-03d6-4bb8-b1a1-6dcf7a60d072]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6c8f32d1-3535-4293-82b0-34aede3f48af tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:45 devstack sudo[109560]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46f33a50-0ad2-4475-8041-1ef412971349 tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a02b6f5-473e-4275-a306-1f8889ff8736 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.a82a545f-d384-4a23-89cb-81e3213daefd" returned: 0 in 0.368s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:45 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-46f33a50-0ad2-4475-8041-1ef412971349 tempest-ProjectReaderTests-257558821 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.a82a545f-d384-4a23-89cb-81e3213daefd is being set with open permissions: ugo+rw
Sep 28 18:31:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46f33a50-0ad2-4475-8041-1ef412971349 tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.a82a545f-d384-4a23-89cb-81e3213daefd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:45 devstack sudo[109566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.a82a545f-d384-4a23-89cb-81e3213daefd
Sep 28 18:31:45 devstack sudo[109566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:45 devstack sudo[109565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e
Sep 28 18:31:45 devstack sudo[109565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:45 devstack sudo[109566]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46f33a50-0ad2-4475-8041-1ef412971349 tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.a82a545f-d384-4a23-89cb-81e3213daefd" returned: 0 in 0.294s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46f33a50-0ad2-4475-8041-1ef412971349 tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:45 devstack sudo[109570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.info
Sep 28 18:31:45 devstack sudo[109570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:45 devstack sudo[109565]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6c8f32d1-3535-4293-82b0-34aede3f48af tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e" returned: 0 in 0.459s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6c8f32d1-3535-4293-82b0-34aede3f48af tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:45 devstack sudo[109575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e
Sep 28 18:31:45 devstack sudo[109575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:45 devstack sudo[109570]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46f33a50-0ad2-4475-8041-1ef412971349 tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.info" returned: 0 in 0.315s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:45 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-46f33a50-0ad2-4475-8041-1ef412971349 tempest-ProjectReaderTests-257558821 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.info is being set with open permissions: ugo+rw
Sep 28 18:31:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46f33a50-0ad2-4475-8041-1ef412971349 tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:45 devstack sudo[109578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.info
Sep 28 18:31:45 devstack sudo[109578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:45 devstack sudo[109575]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:45 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6c8f32d1-3535-4293-82b0-34aede3f48af tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-63dec837-f776-46c5-aec5-5fe785540d7e" returned: 0 in 0.310s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:45 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6c8f32d1-3535-4293-82b0-34aede3f48af tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-63dec837-f776-46c5-aec5-5fe785540d7e" released by "delete_volume" :: held 0.861s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-6c8f32d1-3535-4293-82b0-34aede3f48af tempest-ProjectMemberTests-2016434849 None] Created reservations ['04b870ca-7e40-4cf5-8f63-59aa311d8d1c', '882b774d-f6f4-43e4-ab93-3c9324de949c', 'bbf9fd8e-28db-4269-895a-f1f318aeffa5', '6e877d26-9155-432d-8150-a91a98e1ac1f'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:46 devstack sudo[109578]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-46f33a50-0ad2-4475-8041-1ef412971349 tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.info" returned: 0 in 0.314s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-46f33a50-0ad2-4475-8041-1ef412971349 tempest-ProjectReaderTests-257558821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.328s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6c8f32d1-3535-4293-82b0-34aede3f48af tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6c8f32d1-3535-4293-82b0-34aede3f48af tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6c8f32d1-3535-4293-82b0-34aede3f48af tempest-ProjectMemberTests-2016434849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-6c8f32d1-3535-4293-82b0-34aede3f48af tempest-ProjectMemberTests-2016434849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-6c8f32d1-3535-4293-82b0-34aede3f48af tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6c8f32d1-3535-4293-82b0-34aede3f48af tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:46 devstack sudo[109582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:31:46 devstack sudo[109582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:46 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-46f33a50-0ad2-4475-8041-1ef412971349 tempest-ProjectReaderTests-257558821 None] Create snapshot completed successfully
Sep 28 18:31:46 devstack sudo[109582]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6c8f32d1-3535-4293-82b0-34aede3f48af tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.289s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-6c8f32d1-3535-4293-82b0-34aede3f48af tempest-ProjectMemberTests-2016434849 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:31:46 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-6c8f32d1-3535-4293-82b0-34aede3f48af tempest-ProjectMemberTests-2016434849 None] Deleted volume successfully.
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6c8f32d1-3535-4293-82b0-34aede3f48af tempest-ProjectMemberTests-2016434849 None] Lock "cinder-63dec837-f776-46c5-aec5-5fe785540d7e-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Flow 'volume_create_manager' (e673a896-1411-4c2b-8fa4-10a11e8f0d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2e4dd4-7e17-4c8b-925c-fceb6313e7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2e4dd4-7e17-4c8b-925c-fceb6313e7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-289176584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57437c19-b771-48e3-b71a-2651d8ed93c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7141bfada145467eb777f5e9601f614e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:47Z,use_quota=True,user_id='19ef54da5952457abebbe56a45760423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d23119-841e-4c87-9267-74f5ea5fa0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d23119-841e-4c87-9267-74f5ea5fa0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3127f40f-7094-4632-a262-cbf6cfda9660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3127f40f-7094-4632-a262-cbf6cfda9660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57437c19-b771-48e3-b71a-2651d8ed93c2', 'volume_name': 'volume-57437c19-b771-48e3-b71a-2651d8ed93c2', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d847531c-fd59-4752-8162-920de5d97e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d847531c-fd59-4752-8162-920de5d97e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ddb9f1-c699-4812-b755-f29632b37819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:46 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Volume 57437c19-b771-48e3-b71a-2651d8ed93c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57437c19-b771-48e3-b71a-2651d8ed93c2', 'volume_size': 1}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-289176584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57437c19-b771-48e3-b71a-2651d8ed93c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7141bfada145467eb777f5e9601f614e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:47Z,use_quota=True,user_id='19ef54da5952457abebbe56a45760423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Creating volume 57437c19-b771-48e3-b71a-2651d8ed93c2 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:31:46 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:31:46 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:46 devstack sudo[109585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2 1073741824
Sep 28 18:31:46 devstack sudo[109585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8a43b426-d45d-4fb1-8fcd-45b4ec0ab05c tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-a82a545f-d384-4a23-89cb-81e3213daefd-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8a43b426-d45d-4fb1-8fcd-45b4ec0ab05c tempest-ProjectReaderTests-257558821 None] Lock "cinder-a82a545f-d384-4a23-89cb-81e3213daefd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8a43b426-d45d-4fb1-8fcd-45b4ec0ab05c tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-quobyte-0a02b6f5-473e-4275-a306-1f8889ff8736" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8a43b426-d45d-4fb1-8fcd-45b4ec0ab05c tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-0a02b6f5-473e-4275-a306-1f8889ff8736" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8a43b426-d45d-4fb1-8fcd-45b4ec0ab05c tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-quobyte-a82a545f-d384-4a23-89cb-81e3213daefd" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8a43b426-d45d-4fb1-8fcd-45b4ec0ab05c tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-a82a545f-d384-4a23-89cb-81e3213daefd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-8a43b426-d45d-4fb1-8fcd-45b4ec0ab05c tempest-ProjectReaderTests-257558821 None] Deleting offline snapshot a82a545f-d384-4a23-89cb-81e3213daefd of volume 0a02b6f5-473e-4275-a306-1f8889ff8736 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-8a43b426-d45d-4fb1-8fcd-45b4ec0ab05c tempest-ProjectReaderTests-257558821 None] snapshot_file for this snap is: volume-0a02b6f5-473e-4275-a306-1f8889ff8736.a82a545f-d384-4a23-89cb-81e3213daefd {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4c53a8-25ef-4dac-9c68-0dfd6ce5f0f6]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8a43b426-d45d-4fb1-8fcd-45b4ec0ab05c tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.a82a545f-d384-4a23-89cb-81e3213daefd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:47 devstack sudo[109589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.a82a545f-d384-4a23-89cb-81e3213daefd
Sep 28 18:31:47 devstack sudo[109589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:47 devstack sudo[109585]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2 1073741824" returned: 0 in 0.516s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:47 devstack sudo[109593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2
Sep 28 18:31:47 devstack sudo[109593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:47 devstack sudo[109589]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8a43b426-d45d-4fb1-8fcd-45b4ec0ab05c tempest-ProjectReaderTests-257558821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.a82a545f-d384-4a23-89cb-81e3213daefd" returned: 0 in 0.458s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-8a43b426-d45d-4fb1-8fcd-45b4ec0ab05c tempest-ProjectReaderTests-257558821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a02b6f5-473e-4275-a306-1f8889ff8736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f2ca0f-1f06-4cb7-a636-e0ee05cc4921]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8a43b426-d45d-4fb1-8fcd-45b4ec0ab05c tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:47 devstack sudo[109593]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2" returned: 0 in 0.301s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ddb9f1-c699-4812-b755-f29632b37819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57437c19-b771-48e3-b71a-2651d8ed93c2', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95e0d89-781c-4721-aaca-2103e58ecee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:47 devstack sudo[109598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736
Sep 28 18:31:47 devstack sudo[109598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:47 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Volume volume-57437c19-b771-48e3-b71a-2651d8ed93c2 (57437c19-b771-48e3-b71a-2651d8ed93c2): created successfully
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95e0d89-781c-4721-aaca-2103e58ecee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:47 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Flow 'volume_create_manager' (e673a896-1411-4c2b-8fa4-10a11e8f0d04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:47 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-821e717d-fffd-4059-af39-5c8d2a4b0787 tempest-ProjectMemberTests-2016434849 None] Created volume successfully.
Sep 28 18:31:48 devstack sudo[109598]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8a43b426-d45d-4fb1-8fcd-45b4ec0ab05c tempest-ProjectReaderTests-257558821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736" returned: 0 in 0.411s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8a43b426-d45d-4fb1-8fcd-45b4ec0ab05c tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.a82a545f-d384-4a23-89cb-81e3213daefd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:48 devstack sudo[109604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.a82a545f-d384-4a23-89cb-81e3213daefd
Sep 28 18:31:48 devstack sudo[109604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:48 devstack sudo[109604]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8a43b426-d45d-4fb1-8fcd-45b4ec0ab05c tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.a82a545f-d384-4a23-89cb-81e3213daefd" returned: 0 in 0.389s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8a43b426-d45d-4fb1-8fcd-45b4ec0ab05c tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.a82a545f-d384-4a23-89cb-81e3213daefd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:48 devstack sudo[109610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.a82a545f-d384-4a23-89cb-81e3213daefd
Sep 28 18:31:48 devstack sudo[109610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:48 devstack sudo[109610]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:48 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8a43b426-d45d-4fb1-8fcd-45b4ec0ab05c tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736.a82a545f-d384-4a23-89cb-81e3213daefd" returned: 0 in 0.280s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8a43b426-d45d-4fb1-8fcd-45b4ec0ab05c tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-a82a545f-d384-4a23-89cb-81e3213daefd" released by "_delete_snapshot" :: held 1.675s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8a43b426-d45d-4fb1-8fcd-45b4ec0ab05c tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-0a02b6f5-473e-4275-a306-1f8889ff8736" released by "delete_snapshot" :: held 1.703s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:48 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-8a43b426-d45d-4fb1-8fcd-45b4ec0ab05c tempest-ProjectReaderTests-257558821 None] Created reservations ['66ed33c2-abd8-4a2d-a6d7-9e8530dc761e', '6552e78c-92b3-4092-942a-35ca4b58a6f6', 'b44b7b7d-c1a6-412e-a01d-70a300749073', '5974ac00-d8bd-46dc-859c-b3b39ece93a5'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:48 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-8a43b426-d45d-4fb1-8fcd-45b4ec0ab05c tempest-ProjectReaderTests-257558821 None] Delete snapshot completed successfully.
Sep 28 18:31:48 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-8a43b426-d45d-4fb1-8fcd-45b4ec0ab05c tempest-ProjectReaderTests-257558821 None] Lock "cinder-a82a545f-d384-4a23-89cb-81e3213daefd-delete_snapshot" released by "delete_snapshot" :: held 1.885s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bc5e6213-cf70-40d1-8fb3-32fe58b223b3 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bc5e6213-cf70-40d1-8fb3-32fe58b223b3 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:49 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-bc5e6213-cf70-40d1-8fb3-32fe58b223b3 tempest-ProjectMemberTests-2016434849 None] Creating offline snapshot 5c99cc2e-68d2-4ad9-8165-27d7e2b303dd of volume 57437c19-b771-48e3-b71a-2651d8ed93c2 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:31:49 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[15560f5c-0901-4bb8-9a4c-4cb466660612]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bc5e6213-cf70-40d1-8fb3-32fe58b223b3 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:49 devstack sudo[109613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2
Sep 28 18:31:49 devstack sudo[109613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-711792e9-dbeb-424e-a7fc-ab6be1ad4f62 tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-0a02b6f5-473e-4275-a306-1f8889ff8736-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-711792e9-dbeb-424e-a7fc-ab6be1ad4f62 tempest-ProjectReaderTests-257558821 None] Lock "cinder-0a02b6f5-473e-4275-a306-1f8889ff8736-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-711792e9-dbeb-424e-a7fc-ab6be1ad4f62 tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-quobyte-0a02b6f5-473e-4275-a306-1f8889ff8736" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:49 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-711792e9-dbeb-424e-a7fc-ab6be1ad4f62 tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-0a02b6f5-473e-4275-a306-1f8889ff8736" acquired by "delete_volume" :: waited 0.025s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:49 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b2939d-f40d-4b00-abfe-ec89cabfe48f]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-711792e9-dbeb-424e-a7fc-ab6be1ad4f62 tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:49 devstack sudo[109613]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bc5e6213-cf70-40d1-8fb3-32fe58b223b3 tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2" returned: 0 in 0.409s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bc5e6213-cf70-40d1-8fb3-32fe58b223b3 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.5c99cc2e-68d2-4ad9-8165-27d7e2b303dd 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:49 devstack sudo[109619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.5c99cc2e-68d2-4ad9-8165-27d7e2b303dd 1G
Sep 28 18:31:49 devstack sudo[109619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:49 devstack sudo[109616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736
Sep 28 18:31:49 devstack sudo[109616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:49 devstack sudo[109616]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-711792e9-dbeb-424e-a7fc-ab6be1ad4f62 tempest-ProjectReaderTests-257558821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736" returned: 0 in 0.496s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:49 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-711792e9-dbeb-424e-a7fc-ab6be1ad4f62 tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:49 devstack sudo[109629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736
Sep 28 18:31:49 devstack sudo[109629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:50 devstack sudo[109619]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bc5e6213-cf70-40d1-8fb3-32fe58b223b3 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.5c99cc2e-68d2-4ad9-8165-27d7e2b303dd 1G" returned: 0 in 0.512s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bc5e6213-cf70-40d1-8fb3-32fe58b223b3 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57437c19-b771-48e3-b71a-2651d8ed93c2 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.5c99cc2e-68d2-4ad9-8165-27d7e2b303dd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:50 devstack sudo[109632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57437c19-b771-48e3-b71a-2651d8ed93c2 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.5c99cc2e-68d2-4ad9-8165-27d7e2b303dd
Sep 28 18:31:50 devstack sudo[109632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:50 devstack sudo[109629]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-711792e9-dbeb-424e-a7fc-ab6be1ad4f62 tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-0a02b6f5-473e-4275-a306-1f8889ff8736" returned: 0 in 0.300s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:50 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-711792e9-dbeb-424e-a7fc-ab6be1ad4f62 tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-0a02b6f5-473e-4275-a306-1f8889ff8736" released by "delete_volume" :: held 0.869s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:50 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-711792e9-dbeb-424e-a7fc-ab6be1ad4f62 tempest-ProjectReaderTests-257558821 None] Created reservations ['047c0bdd-df22-4cd4-8531-dd736ce18cab', '1befc2de-8d6b-426c-a182-2bccc61861a1', 'c5b34d82-a9d5-4b20-8189-1dee4b143ef8', '063dfad3-a46c-4f11-b5d8-63ef4a75c8f0'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-711792e9-dbeb-424e-a7fc-ab6be1ad4f62 tempest-ProjectReaderTests-257558821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-711792e9-dbeb-424e-a7fc-ab6be1ad4f62 tempest-ProjectReaderTests-257558821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-711792e9-dbeb-424e-a7fc-ab6be1ad4f62 tempest-ProjectReaderTests-257558821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:50 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-711792e9-dbeb-424e-a7fc-ab6be1ad4f62 tempest-ProjectReaderTests-257558821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-711792e9-dbeb-424e-a7fc-ab6be1ad4f62 tempest-ProjectReaderTests-257558821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:50 devstack sudo[109632]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-711792e9-dbeb-424e-a7fc-ab6be1ad4f62 tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bc5e6213-cf70-40d1-8fb3-32fe58b223b3 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57437c19-b771-48e3-b71a-2651d8ed93c2 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.5c99cc2e-68d2-4ad9-8165-27d7e2b303dd" returned: 0 in 0.381s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:50 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-bc5e6213-cf70-40d1-8fb3-32fe58b223b3 tempest-ProjectMemberTests-2016434849 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.5c99cc2e-68d2-4ad9-8165-27d7e2b303dd is being set with open permissions: ugo+rw
Sep 28 18:31:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bc5e6213-cf70-40d1-8fb3-32fe58b223b3 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.5c99cc2e-68d2-4ad9-8165-27d7e2b303dd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:50 devstack sudo[109638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:31:50 devstack sudo[109638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:50 devstack sudo[109639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.5c99cc2e-68d2-4ad9-8165-27d7e2b303dd
Sep 28 18:31:50 devstack sudo[109639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:50 devstack sudo[109638]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-711792e9-dbeb-424e-a7fc-ab6be1ad4f62 tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.332s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:50 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-711792e9-dbeb-424e-a7fc-ab6be1ad4f62 tempest-ProjectReaderTests-257558821 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:31:50 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-711792e9-dbeb-424e-a7fc-ab6be1ad4f62 tempest-ProjectReaderTests-257558821 None] Deleted volume successfully.
Sep 28 18:31:50 devstack sudo[109639]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bc5e6213-cf70-40d1-8fb3-32fe58b223b3 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.5c99cc2e-68d2-4ad9-8165-27d7e2b303dd" returned: 0 in 0.361s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:50 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-711792e9-dbeb-424e-a7fc-ab6be1ad4f62 tempest-ProjectReaderTests-257558821 None] Lock "cinder-0a02b6f5-473e-4275-a306-1f8889ff8736-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:50 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bc5e6213-cf70-40d1-8fb3-32fe58b223b3 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:50 devstack sudo[109644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.info
Sep 28 18:31:50 devstack sudo[109644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Flow 'volume_create_manager' (7bdadedd-ffc2-40dd-a173-70957add1f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f40ff2-e4cb-4257-8667-47ef650ea7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f40ff2-e4cb-4257-8667-47ef650ea7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-271030252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d0e9356-f6ff-4e32-9d14-a831f92742e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa1f17ecf644a9b93b4b4d10bad8593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:51Z,use_quota=True,user_id='215f54ccefe14730a0310f724f3df258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbb9163-e388-4a25-a8cd-8138b4bcc3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbb9163-e388-4a25-a8cd-8138b4bcc3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429f5f5a-3070-4ec0-aabd-c3363c73684a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429f5f5a-3070-4ec0-aabd-c3363c73684a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d0e9356-f6ff-4e32-9d14-a831f92742e0', 'volume_name': 'volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e17c11-beba-4da3-b6d5-34dcd8b36cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e17c11-beba-4da3-b6d5-34dcd8b36cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:51 devstack sudo[109644]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e723e056-240d-4210-935b-477941c023d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:51 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Volume 4d0e9356-f6ff-4e32-9d14-a831f92742e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0', 'volume_size': 1}
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bc5e6213-cf70-40d1-8fb3-32fe58b223b3 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.info" returned: 0 in 0.339s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:51 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-bc5e6213-cf70-40d1-8fb3-32fe58b223b3 tempest-ProjectMemberTests-2016434849 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.info is being set with open permissions: ugo+rw
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bc5e6213-cf70-40d1-8fb3-32fe58b223b3 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:51 devstack sudo[109647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.info
Sep 28 18:31:51 devstack sudo[109647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:51 devstack sudo[109647]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-bc5e6213-cf70-40d1-8fb3-32fe58b223b3 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.info" returned: 0 in 0.269s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-bc5e6213-cf70-40d1-8fb3-32fe58b223b3 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.374s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.295s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-271030252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d0e9356-f6ff-4e32-9d14-a831f92742e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa1f17ecf644a9b93b4b4d10bad8593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:51Z,use_quota=True,user_id='215f54ccefe14730a0310f724f3df258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Creating volume 4d0e9356-f6ff-4e32-9d14-a831f92742e0 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:31:51 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:51 devstack sudo[109650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0 1073741824
Sep 28 18:31:51 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:51 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-bc5e6213-cf70-40d1-8fb3-32fe58b223b3 tempest-ProjectMemberTests-2016434849 None] Create snapshot completed successfully
Sep 28 18:31:51 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0 1073741824" returned: 0 in 0.480s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:51 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:51 devstack sudo[109656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0
Sep 28 18:31:51 devstack sudo[109656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:52 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b05e73b9-0a23-4fb8-bb7c-f41945f26d80 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-5c99cc2e-68d2-4ad9-8165-27d7e2b303dd-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:52 devstack sudo[109656]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0" returned: 0 in 0.319s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:52 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:31:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:52 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b05e73b9-0a23-4fb8-bb7c-f41945f26d80 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-5c99cc2e-68d2-4ad9-8165-27d7e2b303dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:52 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b05e73b9-0a23-4fb8-bb7c-f41945f26d80 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-57437c19-b771-48e3-b71a-2651d8ed93c2" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e723e056-240d-4210-935b-477941c023d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe050f4-3753-4e88-b7d1-7374af293bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:52 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b05e73b9-0a23-4fb8-bb7c-f41945f26d80 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-57437c19-b771-48e3-b71a-2651d8ed93c2" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:52 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b05e73b9-0a23-4fb8-bb7c-f41945f26d80 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-5c99cc2e-68d2-4ad9-8165-27d7e2b303dd" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:52 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Volume volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0 (4d0e9356-f6ff-4e32-9d14-a831f92742e0): created successfully
Sep 28 18:31:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe050f4-3753-4e88-b7d1-7374af293bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:52 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Flow 'volume_create_manager' (7bdadedd-ffc2-40dd-a173-70957add1f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:52 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b05e73b9-0a23-4fb8-bb7c-f41945f26d80 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-5c99cc2e-68d2-4ad9-8165-27d7e2b303dd" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:52 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-b05e73b9-0a23-4fb8-bb7c-f41945f26d80 tempest-ProjectMemberTests-2016434849 None] Deleting offline snapshot 5c99cc2e-68d2-4ad9-8165-27d7e2b303dd of volume 57437c19-b771-48e3-b71a-2651d8ed93c2 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:31:52 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-b05e73b9-0a23-4fb8-bb7c-f41945f26d80 tempest-ProjectMemberTests-2016434849 None] snapshot_file for this snap is: volume-57437c19-b771-48e3-b71a-2651d8ed93c2.5c99cc2e-68d2-4ad9-8165-27d7e2b303dd {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:31:52 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-20976cbb-fd9f-4893-b1e0-c40be05e67fc tempest-ProjectReaderTests-257558821 None] Created volume successfully.
Sep 28 18:31:52 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ef9d8b-f819-4d72-995b-d9a7dc5b1d93]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b05e73b9-0a23-4fb8-bb7c-f41945f26d80 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.5c99cc2e-68d2-4ad9-8165-27d7e2b303dd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:52 devstack sudo[109659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.5c99cc2e-68d2-4ad9-8165-27d7e2b303dd
Sep 28 18:31:52 devstack sudo[109659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:52 devstack sudo[109659]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b05e73b9-0a23-4fb8-bb7c-f41945f26d80 tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.5c99cc2e-68d2-4ad9-8165-27d7e2b303dd" returned: 0 in 0.409s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:52 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-b05e73b9-0a23-4fb8-bb7c-f41945f26d80 tempest-ProjectMemberTests-2016434849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57437c19-b771-48e3-b71a-2651d8ed93c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:31:52 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7021e6f5-3b06-421d-8a45-03eeb2c38152]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:52 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b05e73b9-0a23-4fb8-bb7c-f41945f26d80 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:52 devstack sudo[109664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2
Sep 28 18:31:52 devstack sudo[109664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8aef4e5a-bf51-4268-bbeb-e1e184cf210f tempest-ProjectReaderTests-257558821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8aef4e5a-bf51-4268-bbeb-e1e184cf210f tempest-ProjectReaderTests-257558821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:53 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-8aef4e5a-bf51-4268-bbeb-e1e184cf210f tempest-ProjectReaderTests-257558821 None] Creating offline snapshot 022bdff6-c16e-4a64-b681-64aac88e1371 of volume 4d0e9356-f6ff-4e32-9d14-a831f92742e0 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:31:53 devstack sudo[109664]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b05e73b9-0a23-4fb8-bb7c-f41945f26d80 tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2" returned: 0 in 0.459s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b05e73b9-0a23-4fb8-bb7c-f41945f26d80 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.5c99cc2e-68d2-4ad9-8165-27d7e2b303dd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:53 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ed1c14-848f-40ab-be7b-6f34beccb9a4]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8aef4e5a-bf51-4268-bbeb-e1e184cf210f tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:53 devstack sudo[109669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.5c99cc2e-68d2-4ad9-8165-27d7e2b303dd
Sep 28 18:31:53 devstack sudo[109669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:53 devstack sudo[109670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0
Sep 28 18:31:53 devstack sudo[109670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:53 devstack sudo[109669]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b05e73b9-0a23-4fb8-bb7c-f41945f26d80 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.5c99cc2e-68d2-4ad9-8165-27d7e2b303dd" returned: 0 in 0.410s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b05e73b9-0a23-4fb8-bb7c-f41945f26d80 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.5c99cc2e-68d2-4ad9-8165-27d7e2b303dd {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:53 devstack sudo[109670]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8aef4e5a-bf51-4268-bbeb-e1e184cf210f tempest-ProjectReaderTests-257558821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0" returned: 0 in 0.411s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:53 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8aef4e5a-bf51-4268-bbeb-e1e184cf210f tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.022bdff6-c16e-4a64-b681-64aac88e1371 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:53 devstack sudo[109681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.5c99cc2e-68d2-4ad9-8165-27d7e2b303dd
Sep 28 18:31:53 devstack sudo[109681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:53 devstack sudo[109682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.022bdff6-c16e-4a64-b681-64aac88e1371 1G
Sep 28 18:31:53 devstack sudo[109682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:54 devstack sudo[109681]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-b05e73b9-0a23-4fb8-bb7c-f41945f26d80 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2.5c99cc2e-68d2-4ad9-8165-27d7e2b303dd" returned: 0 in 0.302s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:54 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b05e73b9-0a23-4fb8-bb7c-f41945f26d80 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-5c99cc2e-68d2-4ad9-8165-27d7e2b303dd" released by "_delete_snapshot" :: held 1.709s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:54 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b05e73b9-0a23-4fb8-bb7c-f41945f26d80 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-57437c19-b771-48e3-b71a-2651d8ed93c2" released by "delete_snapshot" :: held 1.758s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:54 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-b05e73b9-0a23-4fb8-bb7c-f41945f26d80 tempest-ProjectMemberTests-2016434849 None] Created reservations ['e1209109-c6ac-400d-9e04-118e638c79ec', 'd9288dba-db4d-43b8-9c86-02b923e930b7', 'b6b4c9ec-e820-4a04-8004-42e18aa7f245', '4bf1c040-2813-403b-ab44-57c877a8d5f2'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:54 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-b05e73b9-0a23-4fb8-bb7c-f41945f26d80 tempest-ProjectMemberTests-2016434849 None] Delete snapshot completed successfully.
Sep 28 18:31:54 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-b05e73b9-0a23-4fb8-bb7c-f41945f26d80 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-5c99cc2e-68d2-4ad9-8165-27d7e2b303dd-delete_snapshot" released by "delete_snapshot" :: held 1.977s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:54 devstack sudo[109682]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8aef4e5a-bf51-4268-bbeb-e1e184cf210f tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.022bdff6-c16e-4a64-b681-64aac88e1371 1G" returned: 0 in 0.555s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8aef4e5a-bf51-4268-bbeb-e1e184cf210f tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.022bdff6-c16e-4a64-b681-64aac88e1371 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:54 devstack sudo[109690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.022bdff6-c16e-4a64-b681-64aac88e1371
Sep 28 18:31:54 devstack sudo[109690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:54 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5cf503c3-257b-4807-a9e5-1c6ffaea9917 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-57437c19-b771-48e3-b71a-2651d8ed93c2-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:54 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5cf503c3-257b-4807-a9e5-1c6ffaea9917 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-57437c19-b771-48e3-b71a-2651d8ed93c2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:54 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5cf503c3-257b-4807-a9e5-1c6ffaea9917 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-57437c19-b771-48e3-b71a-2651d8ed93c2" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:54 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5cf503c3-257b-4807-a9e5-1c6ffaea9917 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-57437c19-b771-48e3-b71a-2651d8ed93c2" acquired by "delete_volume" :: waited 0.020s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:54 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e590971-d8cb-46c0-8205-440bfd9719d9]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5cf503c3-257b-4807-a9e5-1c6ffaea9917 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:54 devstack sudo[109690]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8aef4e5a-bf51-4268-bbeb-e1e184cf210f tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.022bdff6-c16e-4a64-b681-64aac88e1371" returned: 0 in 0.374s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:54 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-8aef4e5a-bf51-4268-bbeb-e1e184cf210f tempest-ProjectReaderTests-257558821 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.022bdff6-c16e-4a64-b681-64aac88e1371 is being set with open permissions: ugo+rw
Sep 28 18:31:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8aef4e5a-bf51-4268-bbeb-e1e184cf210f tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.022bdff6-c16e-4a64-b681-64aac88e1371 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:54 devstack sudo[109697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.022bdff6-c16e-4a64-b681-64aac88e1371
Sep 28 18:31:54 devstack sudo[109697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:54 devstack sudo[109696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2
Sep 28 18:31:54 devstack sudo[109696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:54 devstack sudo[109697]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:54 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8aef4e5a-bf51-4268-bbeb-e1e184cf210f tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.022bdff6-c16e-4a64-b681-64aac88e1371" returned: 0 in 0.302s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8aef4e5a-bf51-4268-bbeb-e1e184cf210f tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:55 devstack sudo[109704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.info
Sep 28 18:31:55 devstack sudo[109704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:55 devstack sudo[109696]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5cf503c3-257b-4807-a9e5-1c6ffaea9917 tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2" returned: 0 in 0.446s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5cf503c3-257b-4807-a9e5-1c6ffaea9917 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:55 devstack sudo[109706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2
Sep 28 18:31:55 devstack sudo[109706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:55 devstack sudo[109704]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8aef4e5a-bf51-4268-bbeb-e1e184cf210f tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.info" returned: 0 in 0.298s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:55 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-8aef4e5a-bf51-4268-bbeb-e1e184cf210f tempest-ProjectReaderTests-257558821 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.info is being set with open permissions: ugo+rw
Sep 28 18:31:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8aef4e5a-bf51-4268-bbeb-e1e184cf210f tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:55 devstack sudo[109710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.info
Sep 28 18:31:55 devstack sudo[109710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:55 devstack sudo[109706]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5cf503c3-257b-4807-a9e5-1c6ffaea9917 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-57437c19-b771-48e3-b71a-2651d8ed93c2" returned: 0 in 0.290s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:55 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5cf503c3-257b-4807-a9e5-1c6ffaea9917 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-57437c19-b771-48e3-b71a-2651d8ed93c2" released by "delete_volume" :: held 0.809s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:55 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-5cf503c3-257b-4807-a9e5-1c6ffaea9917 tempest-ProjectMemberTests-2016434849 None] Created reservations ['4e69c9db-dbb6-41a6-894a-7c9fa5c9caa3', '83fd70ac-3958-4152-be35-df6883dc331d', 'c6f4d495-5128-49cd-95a3-18c6ef0cc38e', '4680416b-ef17-4270-a2b8-bb4dc8ca83da'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5cf503c3-257b-4807-a9e5-1c6ffaea9917 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5cf503c3-257b-4807-a9e5-1c6ffaea9917 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5cf503c3-257b-4807-a9e5-1c6ffaea9917 tempest-ProjectMemberTests-2016434849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:55 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-5cf503c3-257b-4807-a9e5-1c6ffaea9917 tempest-ProjectMemberTests-2016434849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-5cf503c3-257b-4807-a9e5-1c6ffaea9917 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5cf503c3-257b-4807-a9e5-1c6ffaea9917 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:55 devstack sudo[109712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:31:55 devstack sudo[109712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:55 devstack sudo[109710]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-8aef4e5a-bf51-4268-bbeb-e1e184cf210f tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.info" returned: 0 in 0.320s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-8aef4e5a-bf51-4268-bbeb-e1e184cf210f tempest-ProjectReaderTests-257558821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.378s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:55 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-8aef4e5a-bf51-4268-bbeb-e1e184cf210f tempest-ProjectReaderTests-257558821 None] Create snapshot completed successfully
Sep 28 18:31:55 devstack sudo[109712]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:55 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-5cf503c3-257b-4807-a9e5-1c6ffaea9917 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.294s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:55 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-5cf503c3-257b-4807-a9e5-1c6ffaea9917 tempest-ProjectMemberTests-2016434849 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:31:55 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-5cf503c3-257b-4807-a9e5-1c6ffaea9917 tempest-ProjectMemberTests-2016434849 None] Deleted volume successfully.
Sep 28 18:31:55 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-5cf503c3-257b-4807-a9e5-1c6ffaea9917 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-57437c19-b771-48e3-b71a-2651d8ed93c2-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Flow 'volume_create_manager' (c6606308-7c43-49e5-b9d3-9decce76f160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08628fbc-0fb0-48a2-8ec7-bed8aef61717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08628fbc-0fb0-48a2-8ec7-bed8aef61717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-186221131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab5a8f08-39d3-473f-acfe-b9f99af959e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7141bfada145467eb777f5e9601f614e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:56Z,use_quota=True,user_id='19ef54da5952457abebbe56a45760423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2261bcdc-8733-4de5-8c6e-0ccf45db10e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2261bcdc-8733-4de5-8c6e-0ccf45db10e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4700d424-030a-42e1-a391-08ef410520bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4700d424-030a-42e1-a391-08ef410520bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab5a8f08-39d3-473f-acfe-b9f99af959e1', 'volume_name': 'volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d894bd14-5a7d-4b7f-b118-ec3110a04762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d894bd14-5a7d-4b7f-b118-ec3110a04762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25911a90-118f-4dbc-9680-75898efe4256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:56 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Volume ab5a8f08-39d3-473f-acfe-b9f99af959e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1', 'volume_size': 1}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-186221131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab5a8f08-39d3-473f-acfe-b9f99af959e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7141bfada145467eb777f5e9601f614e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:56Z,use_quota=True,user_id='19ef54da5952457abebbe56a45760423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Creating volume ab5a8f08-39d3-473f-acfe-b9f99af959e1 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:31:56 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:56 devstack sudo[109716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1 1073741824
Sep 28 18:31:56 devstack sudo[109716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f4f1e9b0-a37c-4d98-9242-a8cfe52ac32d tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-022bdff6-c16e-4a64-b681-64aac88e1371-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f4f1e9b0-a37c-4d98-9242-a8cfe52ac32d tempest-ProjectReaderTests-257558821 None] Lock "cinder-022bdff6-c16e-4a64-b681-64aac88e1371-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f4f1e9b0-a37c-4d98-9242-a8cfe52ac32d tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-quobyte-4d0e9356-f6ff-4e32-9d14-a831f92742e0" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f4f1e9b0-a37c-4d98-9242-a8cfe52ac32d tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-4d0e9356-f6ff-4e32-9d14-a831f92742e0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f4f1e9b0-a37c-4d98-9242-a8cfe52ac32d tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-quobyte-022bdff6-c16e-4a64-b681-64aac88e1371" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f4f1e9b0-a37c-4d98-9242-a8cfe52ac32d tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-022bdff6-c16e-4a64-b681-64aac88e1371" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-f4f1e9b0-a37c-4d98-9242-a8cfe52ac32d tempest-ProjectReaderTests-257558821 None] Deleting offline snapshot 022bdff6-c16e-4a64-b681-64aac88e1371 of volume 4d0e9356-f6ff-4e32-9d14-a831f92742e0 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-f4f1e9b0-a37c-4d98-9242-a8cfe52ac32d tempest-ProjectReaderTests-257558821 None] snapshot_file for this snap is: volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.022bdff6-c16e-4a64-b681-64aac88e1371 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8ac78c-b589-429a-90e2-ef61e19cd947]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f4f1e9b0-a37c-4d98-9242-a8cfe52ac32d tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.022bdff6-c16e-4a64-b681-64aac88e1371 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:56 devstack sudo[109722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.022bdff6-c16e-4a64-b681-64aac88e1371
Sep 28 18:31:56 devstack sudo[109722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:56 devstack sudo[109716]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1 1073741824" returned: 0 in 0.524s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:56 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:56 devstack sudo[109724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1
Sep 28 18:31:56 devstack sudo[109724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:57 devstack sudo[109724]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:57 devstack sudo[109722]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1" returned: 0 in 0.300s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:57 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:31:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f4f1e9b0-a37c-4d98-9242-a8cfe52ac32d tempest-ProjectReaderTests-257558821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.022bdff6-c16e-4a64-b681-64aac88e1371" returned: 0 in 0.517s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:57 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-f4f1e9b0-a37c-4d98-9242-a8cfe52ac32d tempest-ProjectReaderTests-257558821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:31:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25911a90-118f-4dbc-9680-75898efe4256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bdc8c63-af58-4110-b5c1-0bf0d1c44089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:31:57 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ac2a78-7675-4850-82c4-99eac71fca9f]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f4f1e9b0-a37c-4d98-9242-a8cfe52ac32d tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:57 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Volume volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1 (ab5a8f08-39d3-473f-acfe-b9f99af959e1): created successfully
Sep 28 18:31:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bdc8c63-af58-4110-b5c1-0bf0d1c44089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:31:57 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Flow 'volume_create_manager' (c6606308-7c43-49e5-b9d3-9decce76f160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:31:57 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-aa59961a-2695-4ef3-bab1-afe3d75ba248 tempest-ProjectMemberTests-2016434849 None] Created volume successfully.
Sep 28 18:31:57 devstack sudo[109730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0
Sep 28 18:31:57 devstack sudo[109730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:57 devstack sudo[109730]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f4f1e9b0-a37c-4d98-9242-a8cfe52ac32d tempest-ProjectReaderTests-257558821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0" returned: 0 in 0.401s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:57 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f4f1e9b0-a37c-4d98-9242-a8cfe52ac32d tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.022bdff6-c16e-4a64-b681-64aac88e1371 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:57 devstack sudo[109735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.022bdff6-c16e-4a64-b681-64aac88e1371
Sep 28 18:31:57 devstack sudo[109735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:57 devstack sudo[109735]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f4f1e9b0-a37c-4d98-9242-a8cfe52ac32d tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.022bdff6-c16e-4a64-b681-64aac88e1371" returned: 0 in 0.347s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f4f1e9b0-a37c-4d98-9242-a8cfe52ac32d tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.022bdff6-c16e-4a64-b681-64aac88e1371 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:58 devstack sudo[109740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.022bdff6-c16e-4a64-b681-64aac88e1371
Sep 28 18:31:58 devstack sudo[109740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:58 devstack sudo[109740]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f4f1e9b0-a37c-4d98-9242-a8cfe52ac32d tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0.022bdff6-c16e-4a64-b681-64aac88e1371" returned: 0 in 0.288s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f4f1e9b0-a37c-4d98-9242-a8cfe52ac32d tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-022bdff6-c16e-4a64-b681-64aac88e1371" released by "_delete_snapshot" :: held 1.680s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f4f1e9b0-a37c-4d98-9242-a8cfe52ac32d tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-4d0e9356-f6ff-4e32-9d14-a831f92742e0" released by "delete_snapshot" :: held 1.713s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:58 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-f4f1e9b0-a37c-4d98-9242-a8cfe52ac32d tempest-ProjectReaderTests-257558821 None] Created reservations ['0630875a-81ba-4526-8dce-5ccc08f5bceb', '2a42a52f-dde4-490a-855b-2dfd6e91b06f', 'cacfa8b6-d65b-46a6-b9b8-7bb7e1f45e1c', 'b78a7a47-97e8-4bcb-b693-87eea7db12a5'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9d5c06e2-5e64-4bb3-908f-5ed231cdbd07 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9d5c06e2-5e64-4bb3-908f-5ed231cdbd07 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:58 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-9d5c06e2-5e64-4bb3-908f-5ed231cdbd07 tempest-ProjectMemberTests-2016434849 None] Creating offline snapshot 6bfbb7ec-08fc-48f7-8b64-813093f6e4da of volume ab5a8f08-39d3-473f-acfe-b9f99af959e1 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:31:58 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-f4f1e9b0-a37c-4d98-9242-a8cfe52ac32d tempest-ProjectReaderTests-257558821 None] Delete snapshot completed successfully.
Sep 28 18:31:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f4f1e9b0-a37c-4d98-9242-a8cfe52ac32d tempest-ProjectReaderTests-257558821 None] Lock "cinder-022bdff6-c16e-4a64-b681-64aac88e1371-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:58 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fe6296-a3fd-478a-bcee-87e146ebb69b]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d5c06e2-5e64-4bb3-908f-5ed231cdbd07 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:58 devstack sudo[109743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1
Sep 28 18:31:58 devstack sudo[109743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f3e7a376-d25e-4f90-9c24-4c32b1e4000b tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-4d0e9356-f6ff-4e32-9d14-a831f92742e0-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f3e7a376-d25e-4f90-9c24-4c32b1e4000b tempest-ProjectReaderTests-257558821 None] Lock "cinder-4d0e9356-f6ff-4e32-9d14-a831f92742e0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f3e7a376-d25e-4f90-9c24-4c32b1e4000b tempest-ProjectReaderTests-257558821 None] Acquiring lock "cinder-quobyte-4d0e9356-f6ff-4e32-9d14-a831f92742e0" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:31:58 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f3e7a376-d25e-4f90-9c24-4c32b1e4000b tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-4d0e9356-f6ff-4e32-9d14-a831f92742e0" acquired by "delete_volume" :: waited 0.019s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:31:58 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f721b105-8550-4b0c-a4ea-afc70fe9af03]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:31:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f3e7a376-d25e-4f90-9c24-4c32b1e4000b tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:58 devstack sudo[109743]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d5c06e2-5e64-4bb3-908f-5ed231cdbd07 tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1" returned: 0 in 0.435s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:58 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d5c06e2-5e64-4bb3-908f-5ed231cdbd07 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.6bfbb7ec-08fc-48f7-8b64-813093f6e4da 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:59 devstack sudo[109749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.6bfbb7ec-08fc-48f7-8b64-813093f6e4da 1G
Sep 28 18:31:59 devstack sudo[109749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:59 devstack sudo[109747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0
Sep 28 18:31:59 devstack sudo[109747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:59 devstack sudo[109747]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f3e7a376-d25e-4f90-9c24-4c32b1e4000b tempest-ProjectReaderTests-257558821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0" returned: 0 in 0.397s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f3e7a376-d25e-4f90-9c24-4c32b1e4000b tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:59 devstack sudo[109758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0
Sep 28 18:31:59 devstack sudo[109758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:59 devstack sudo[109749]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d5c06e2-5e64-4bb3-908f-5ed231cdbd07 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.6bfbb7ec-08fc-48f7-8b64-813093f6e4da 1G" returned: 0 in 0.487s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d5c06e2-5e64-4bb3-908f-5ed231cdbd07 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.6bfbb7ec-08fc-48f7-8b64-813093f6e4da {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:59 devstack sudo[109761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.6bfbb7ec-08fc-48f7-8b64-813093f6e4da
Sep 28 18:31:59 devstack sudo[109761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:59 devstack sudo[109758]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f3e7a376-d25e-4f90-9c24-4c32b1e4000b tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-4d0e9356-f6ff-4e32-9d14-a831f92742e0" returned: 0 in 0.318s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:59 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f3e7a376-d25e-4f90-9c24-4c32b1e4000b tempest-ProjectReaderTests-257558821 None] Lock "cinder-quobyte-4d0e9356-f6ff-4e32-9d14-a831f92742e0" released by "delete_volume" :: held 0.797s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:31:59 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-f3e7a376-d25e-4f90-9c24-4c32b1e4000b tempest-ProjectReaderTests-257558821 None] Created reservations ['0abb1779-e38b-4624-9a0d-972ebd70ce45', '96d715c7-a5a2-4e79-a5f4-3040a85509dc', '8ff1bcbf-3e8b-49c4-ac88-571a0e11b6c2', 'e6bb82b7-b126-4cee-a143-87836b776fe2'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:31:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f3e7a376-d25e-4f90-9c24-4c32b1e4000b tempest-ProjectReaderTests-257558821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:31:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f3e7a376-d25e-4f90-9c24-4c32b1e4000b tempest-ProjectReaderTests-257558821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:31:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7a376-d25e-4f90-9c24-4c32b1e4000b tempest-ProjectReaderTests-257558821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:31:59 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7a376-d25e-4f90-9c24-4c32b1e4000b tempest-ProjectReaderTests-257558821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:31:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-f3e7a376-d25e-4f90-9c24-4c32b1e4000b tempest-ProjectReaderTests-257558821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:31:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f3e7a376-d25e-4f90-9c24-4c32b1e4000b tempest-ProjectReaderTests-257558821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:59 devstack sudo[109761]: pam_unix(sudo:session): session closed for user root
Sep 28 18:31:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d5c06e2-5e64-4bb3-908f-5ed231cdbd07 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.6bfbb7ec-08fc-48f7-8b64-813093f6e4da" returned: 0 in 0.356s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:31:59 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-9d5c06e2-5e64-4bb3-908f-5ed231cdbd07 tempest-ProjectMemberTests-2016434849 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.6bfbb7ec-08fc-48f7-8b64-813093f6e4da is being set with open permissions: ugo+rw
Sep 28 18:31:59 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d5c06e2-5e64-4bb3-908f-5ed231cdbd07 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.6bfbb7ec-08fc-48f7-8b64-813093f6e4da {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:31:59 devstack sudo[109767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:31:59 devstack sudo[109767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:31:59 devstack sudo[109768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.6bfbb7ec-08fc-48f7-8b64-813093f6e4da
Sep 28 18:31:59 devstack sudo[109768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:00 devstack sudo[109767]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-f3e7a376-d25e-4f90-9c24-4c32b1e4000b tempest-ProjectReaderTests-257558821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.328s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:00 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-f3e7a376-d25e-4f90-9c24-4c32b1e4000b tempest-ProjectReaderTests-257558821 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:32:00 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-f3e7a376-d25e-4f90-9c24-4c32b1e4000b tempest-ProjectReaderTests-257558821 None] Deleted volume successfully.
Sep 28 18:32:00 devstack sudo[109768]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d5c06e2-5e64-4bb3-908f-5ed231cdbd07 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.6bfbb7ec-08fc-48f7-8b64-813093f6e4da" returned: 0 in 0.339s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:00 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-f3e7a376-d25e-4f90-9c24-4c32b1e4000b tempest-ProjectReaderTests-257558821 None] Lock "cinder-4d0e9356-f6ff-4e32-9d14-a831f92742e0-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:32:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d5c06e2-5e64-4bb3-908f-5ed231cdbd07 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:00 devstack sudo[109773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.info
Sep 28 18:32:00 devstack sudo[109773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:00 devstack sudo[109773]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d5c06e2-5e64-4bb3-908f-5ed231cdbd07 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.info" returned: 0 in 0.291s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:00 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-9d5c06e2-5e64-4bb3-908f-5ed231cdbd07 tempest-ProjectMemberTests-2016434849 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.info is being set with open permissions: ugo+rw
Sep 28 18:32:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d5c06e2-5e64-4bb3-908f-5ed231cdbd07 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:00 devstack sudo[109776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.info
Sep 28 18:32:00 devstack sudo[109776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:00 devstack sudo[109776]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-9d5c06e2-5e64-4bb3-908f-5ed231cdbd07 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.info" returned: 0 in 0.274s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:00 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-9d5c06e2-5e64-4bb3-908f-5ed231cdbd07 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.363s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:32:00 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-9d5c06e2-5e64-4bb3-908f-5ed231cdbd07 tempest-ProjectMemberTests-2016434849 None] Create snapshot completed successfully
Sep 28 18:32:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6c6996fe-10cf-4879-9177-a57be1f30909 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-6bfbb7ec-08fc-48f7-8b64-813093f6e4da-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:32:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6c6996fe-10cf-4879-9177-a57be1f30909 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-6bfbb7ec-08fc-48f7-8b64-813093f6e4da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:32:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6c6996fe-10cf-4879-9177-a57be1f30909 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-ab5a8f08-39d3-473f-acfe-b9f99af959e1" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:32:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6c6996fe-10cf-4879-9177-a57be1f30909 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-ab5a8f08-39d3-473f-acfe-b9f99af959e1" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:32:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6c6996fe-10cf-4879-9177-a57be1f30909 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-6bfbb7ec-08fc-48f7-8b64-813093f6e4da" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:32:01 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6c6996fe-10cf-4879-9177-a57be1f30909 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-6bfbb7ec-08fc-48f7-8b64-813093f6e4da" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:32:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-6c6996fe-10cf-4879-9177-a57be1f30909 tempest-ProjectMemberTests-2016434849 None] Deleting offline snapshot 6bfbb7ec-08fc-48f7-8b64-813093f6e4da of volume ab5a8f08-39d3-473f-acfe-b9f99af959e1 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:32:01 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-6c6996fe-10cf-4879-9177-a57be1f30909 tempest-ProjectMemberTests-2016434849 None] snapshot_file for this snap is: volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.6bfbb7ec-08fc-48f7-8b64-813093f6e4da {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:32:01 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a34f4f8-2bfc-44c1-a1f5-127e6d23a0ae]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:32:01 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6c6996fe-10cf-4879-9177-a57be1f30909 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.6bfbb7ec-08fc-48f7-8b64-813093f6e4da {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:02 devstack sudo[109780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.6bfbb7ec-08fc-48f7-8b64-813093f6e4da
Sep 28 18:32:02 devstack sudo[109780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:02 devstack sudo[109780]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6c6996fe-10cf-4879-9177-a57be1f30909 tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.6bfbb7ec-08fc-48f7-8b64-813093f6e4da" returned: 0 in 0.500s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:02 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-6c6996fe-10cf-4879-9177-a57be1f30909 tempest-ProjectMemberTests-2016434849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:32:02 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[988802d9-5e65-4364-b017-922373e50e01]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:32:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6c6996fe-10cf-4879-9177-a57be1f30909 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:02 devstack sudo[109791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1
Sep 28 18:32:02 devstack sudo[109791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:02 devstack sudo[109791]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6c6996fe-10cf-4879-9177-a57be1f30909 tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1" returned: 0 in 0.453s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:02 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6c6996fe-10cf-4879-9177-a57be1f30909 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.6bfbb7ec-08fc-48f7-8b64-813093f6e4da {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:02 devstack sudo[109796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.6bfbb7ec-08fc-48f7-8b64-813093f6e4da
Sep 28 18:32:02 devstack sudo[109796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:03 devstack sudo[109796]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6c6996fe-10cf-4879-9177-a57be1f30909 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.6bfbb7ec-08fc-48f7-8b64-813093f6e4da" returned: 0 in 0.395s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6c6996fe-10cf-4879-9177-a57be1f30909 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.6bfbb7ec-08fc-48f7-8b64-813093f6e4da {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:03 devstack sudo[109801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.6bfbb7ec-08fc-48f7-8b64-813093f6e4da
Sep 28 18:32:03 devstack sudo[109801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:03 devstack sudo[109801]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:03 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-6c6996fe-10cf-4879-9177-a57be1f30909 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1.6bfbb7ec-08fc-48f7-8b64-813093f6e4da" returned: 0 in 0.310s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6c6996fe-10cf-4879-9177-a57be1f30909 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-6bfbb7ec-08fc-48f7-8b64-813093f6e4da" released by "_delete_snapshot" :: held 1.791s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:32:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6c6996fe-10cf-4879-9177-a57be1f30909 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-ab5a8f08-39d3-473f-acfe-b9f99af959e1" released by "delete_snapshot" :: held 1.819s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:32:03 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-6c6996fe-10cf-4879-9177-a57be1f30909 tempest-ProjectMemberTests-2016434849 None] Created reservations ['ee8f7939-3320-4c8c-84a9-63235ceb1540', 'f3af353c-4d76-46a9-b4fa-52e4d359f9bb', '22e75271-ca97-4c52-890b-b2b68e3ef1dd', '87170c30-8000-49f2-a2f7-427f7099f7ce'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:32:03 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-6c6996fe-10cf-4879-9177-a57be1f30909 tempest-ProjectMemberTests-2016434849 None] Delete snapshot completed successfully.
Sep 28 18:32:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-6c6996fe-10cf-4879-9177-a57be1f30909 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-6bfbb7ec-08fc-48f7-8b64-813093f6e4da-delete_snapshot" released by "delete_snapshot" :: held 2.008s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:32:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-659016aa-3827-4eee-8f45-89db97d18cf5 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-ab5a8f08-39d3-473f-acfe-b9f99af959e1-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:32:03 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-659016aa-3827-4eee-8f45-89db97d18cf5 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-ab5a8f08-39d3-473f-acfe-b9f99af959e1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:32:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-659016aa-3827-4eee-8f45-89db97d18cf5 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-ab5a8f08-39d3-473f-acfe-b9f99af959e1" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:32:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-659016aa-3827-4eee-8f45-89db97d18cf5 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-ab5a8f08-39d3-473f-acfe-b9f99af959e1" acquired by "delete_volume" :: waited 0.026s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:32:04 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc8725d-7275-4968-8d75-fa377de577ee]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:32:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-659016aa-3827-4eee-8f45-89db97d18cf5 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:04 devstack sudo[109805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1
Sep 28 18:32:04 devstack sudo[109805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:04 devstack sudo[109805]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-659016aa-3827-4eee-8f45-89db97d18cf5 tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1" returned: 0 in 0.406s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-659016aa-3827-4eee-8f45-89db97d18cf5 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:04 devstack sudo[109810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1
Sep 28 18:32:04 devstack sudo[109810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:04 devstack sudo[109810]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-659016aa-3827-4eee-8f45-89db97d18cf5 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-ab5a8f08-39d3-473f-acfe-b9f99af959e1" returned: 0 in 0.256s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:04 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-659016aa-3827-4eee-8f45-89db97d18cf5 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-ab5a8f08-39d3-473f-acfe-b9f99af959e1" released by "delete_volume" :: held 0.739s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:32:04 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-659016aa-3827-4eee-8f45-89db97d18cf5 tempest-ProjectMemberTests-2016434849 None] Created reservations ['a963e059-ecda-4515-a9a6-2fea42afb439', '60836429-b238-4167-8c78-e67d031c3b58', 'b56af6dd-7cfe-4131-b75e-35b4fdd4acc5', '9154fb35-8164-49fe-8e00-3460d2e5cebb'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:32:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-659016aa-3827-4eee-8f45-89db97d18cf5 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:32:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-659016aa-3827-4eee-8f45-89db97d18cf5 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:32:04 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-659016aa-3827-4eee-8f45-89db97d18cf5 tempest-ProjectMemberTests-2016434849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:32:04 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-659016aa-3827-4eee-8f45-89db97d18cf5 tempest-ProjectMemberTests-2016434849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:32:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-659016aa-3827-4eee-8f45-89db97d18cf5 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:32:04 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-659016aa-3827-4eee-8f45-89db97d18cf5 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:04 devstack sudo[109813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:32:04 devstack sudo[109813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:05 devstack sudo[109813]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-659016aa-3827-4eee-8f45-89db97d18cf5 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.281s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-659016aa-3827-4eee-8f45-89db97d18cf5 tempest-ProjectMemberTests-2016434849 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:32:05 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-659016aa-3827-4eee-8f45-89db97d18cf5 tempest-ProjectMemberTests-2016434849 None] Deleted volume successfully.
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-659016aa-3827-4eee-8f45-89db97d18cf5 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-ab5a8f08-39d3-473f-acfe-b9f99af959e1-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Flow 'volume_create_manager' (dfc3999c-ff11-428c-b812-a52463fa54c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e43e85e-3c70-43cb-91cb-358db1b7ca72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e43e85e-3c70-43cb-91cb-358db1b7ca72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1809616087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a83051f-5f4e-492e-a576-1e608763f5c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7141bfada145467eb777f5e9601f614e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:32:06Z,use_quota=True,user_id='19ef54da5952457abebbe56a45760423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933c14d3-89c0-4978-9349-66f4b826a37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933c14d3-89c0-4978-9349-66f4b826a37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0e621e-b3bc-41b6-be46-86d52bddec6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0e621e-b3bc-41b6-be46-86d52bddec6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a83051f-5f4e-492e-a576-1e608763f5c1', 'volume_name': 'volume-5a83051f-5f4e-492e-a576-1e608763f5c1', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfbcd7f5-e2f9-44ec-881e-f11e7c2c93b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfbcd7f5-e2f9-44ec-881e-f11e7c2c93b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1316a3a-d460-4ed9-813a-bc7dafac6574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:32:05 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Volume 5a83051f-5f4e-492e-a576-1e608763f5c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a83051f-5f4e-492e-a576-1e608763f5c1', 'volume_size': 1}
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a6aaf7b7da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-28T16:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1809616087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a83051f-5f4e-492e-a576-1e608763f5c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7141bfada145467eb777f5e9601f614e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:32:06Z,use_quota=True,user_id='19ef54da5952457abebbe56a45760423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b0773-3a1b-4ae5-8525-c380e7218364),volume_type_id=069b0773-3a1b-4ae5-8525-c380e7218364)}" {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Creating volume 5a83051f-5f4e-492e-a576-1e608763f5c1 {{(pid=87046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Selected osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898 as target Quobyte volume. {{(pid=87046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 28 18:32:05 devstack cinder-volume[87046]: INFO cinder.volume.drivers.remotefs [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] casted to osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898
Sep 28 18:32:05 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1 1073741824 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:05 devstack sudo[109816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1 1073741824
Sep 28 18:32:05 devstack sudo[109816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:06 devstack sudo[109816]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1 1073741824" returned: 0 in 0.510s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:06 devstack sudo[109821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1
Sep 28 18:32:06 devstack sudo[109821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:06 devstack sudo[109821]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1" returned: 0 in 0.310s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:06 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'} {{(pid=87046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 28 18:32:06 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:32:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1316a3a-d460-4ed9-813a-bc7dafac6574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a83051f-5f4e-492e-a576-1e608763f5c1', 'volume_size': 1}' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:32:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (709b6427-9eeb-4071-9b75-dba56c85489d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 28 18:32:06 devstack cinder-volume[87046]: INFO cinder.volume.flows.manager.create_volume [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Volume volume-5a83051f-5f4e-492e-a576-1e608763f5c1 (5a83051f-5f4e-492e-a576-1e608763f5c1): created successfully
Sep 28 18:32:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (709b6427-9eeb-4071-9b75-dba56c85489d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 28 18:32:06 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Flow 'volume_create_manager' (dfc3999c-ff11-428c-b812-a52463fa54c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 28 18:32:06 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-d0579bb8-c9cd-4477-9225-34741dd0f76a tempest-ProjectMemberTests-2016434849 None] Created volume successfully.
Sep 28 18:32:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-02128549-4b9b-449d-87da-5f7ec8256ba1 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:32:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-02128549-4b9b-449d-87da-5f7ec8256ba1 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:32:07 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-02128549-4b9b-449d-87da-5f7ec8256ba1 tempest-ProjectMemberTests-2016434849 None] Creating offline snapshot bc58b2a2-bc91-4803-a92a-7c7593ec6f68 of volume 5a83051f-5f4e-492e-a576-1e608763f5c1 {{(pid=87046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 28 18:32:07 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb1c075-844e-4e47-ab47-331574b2a73c]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:32:07 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02128549-4b9b-449d-87da-5f7ec8256ba1 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:08 devstack sudo[109824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1
Sep 28 18:32:08 devstack sudo[109824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:08 devstack sudo[109824]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02128549-4b9b-449d-87da-5f7ec8256ba1 tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1" returned: 0 in 0.405s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02128549-4b9b-449d-87da-5f7ec8256ba1 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.bc58b2a2-bc91-4803-a92a-7c7593ec6f68 1G {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:08 devstack sudo[109829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.bc58b2a2-bc91-4803-a92a-7c7593ec6f68 1G
Sep 28 18:32:08 devstack sudo[109829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:08 devstack sudo[109829]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02128549-4b9b-449d-87da-5f7ec8256ba1 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.bc58b2a2-bc91-4803-a92a-7c7593ec6f68 1G" returned: 0 in 0.475s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:08 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02128549-4b9b-449d-87da-5f7ec8256ba1 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a83051f-5f4e-492e-a576-1e608763f5c1 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.bc58b2a2-bc91-4803-a92a-7c7593ec6f68 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:08 devstack sudo[109835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a83051f-5f4e-492e-a576-1e608763f5c1 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.bc58b2a2-bc91-4803-a92a-7c7593ec6f68
Sep 28 18:32:08 devstack sudo[109835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:09 devstack sudo[109835]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02128549-4b9b-449d-87da-5f7ec8256ba1 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a83051f-5f4e-492e-a576-1e608763f5c1 -F qcow2 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.bc58b2a2-bc91-4803-a92a-7c7593ec6f68" returned: 0 in 0.323s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:09 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-02128549-4b9b-449d-87da-5f7ec8256ba1 tempest-ProjectMemberTests-2016434849 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.bc58b2a2-bc91-4803-a92a-7c7593ec6f68 is being set with open permissions: ugo+rw
Sep 28 18:32:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02128549-4b9b-449d-87da-5f7ec8256ba1 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.bc58b2a2-bc91-4803-a92a-7c7593ec6f68 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:09 devstack sudo[109840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.bc58b2a2-bc91-4803-a92a-7c7593ec6f68
Sep 28 18:32:09 devstack sudo[109840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:09 devstack sudo[109840]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02128549-4b9b-449d-87da-5f7ec8256ba1 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.bc58b2a2-bc91-4803-a92a-7c7593ec6f68" returned: 0 in 0.264s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02128549-4b9b-449d-87da-5f7ec8256ba1 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:09 devstack sudo[109843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.info
Sep 28 18:32:09 devstack sudo[109843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:09 devstack sudo[109843]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02128549-4b9b-449d-87da-5f7ec8256ba1 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.info" returned: 0 in 0.271s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:09 devstack cinder-volume[87046]: WARNING cinder.volume.drivers.remotefs [None req-02128549-4b9b-449d-87da-5f7ec8256ba1 tempest-ProjectMemberTests-2016434849 None] /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.info is being set with open permissions: ugo+rw
Sep 28 18:32:09 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02128549-4b9b-449d-87da-5f7ec8256ba1 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.info {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:09 devstack sudo[109846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.info
Sep 28 18:32:09 devstack sudo[109846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:10 devstack sudo[109846]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-02128549-4b9b-449d-87da-5f7ec8256ba1 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.info" returned: 0 in 0.263s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:10 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-02128549-4b9b-449d-87da-5f7ec8256ba1 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:32:10 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-02128549-4b9b-449d-87da-5f7ec8256ba1 tempest-ProjectMemberTests-2016434849 None] Create snapshot completed successfully
Sep 28 18:32:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4f4e75fb-3007-45a2-a9bd-f1e26407c2d5 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-bc58b2a2-bc91-4803-a92a-7c7593ec6f68-delete_snapshot" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:32:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4f4e75fb-3007-45a2-a9bd-f1e26407c2d5 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-bc58b2a2-bc91-4803-a92a-7c7593ec6f68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:32:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4f4e75fb-3007-45a2-a9bd-f1e26407c2d5 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-5a83051f-5f4e-492e-a576-1e608763f5c1" by "delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:32:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4f4e75fb-3007-45a2-a9bd-f1e26407c2d5 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-5a83051f-5f4e-492e-a576-1e608763f5c1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:32:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4f4e75fb-3007-45a2-a9bd-f1e26407c2d5 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-bc58b2a2-bc91-4803-a92a-7c7593ec6f68" by "_delete_snapshot" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:32:11 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4f4e75fb-3007-45a2-a9bd-f1e26407c2d5 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-bc58b2a2-bc91-4803-a92a-7c7593ec6f68" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:32:11 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-4f4e75fb-3007-45a2-a9bd-f1e26407c2d5 tempest-ProjectMemberTests-2016434849 None] Deleting offline snapshot bc58b2a2-bc91-4803-a92a-7c7593ec6f68 of volume 5a83051f-5f4e-492e-a576-1e608763f5c1 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 28 18:32:11 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-4f4e75fb-3007-45a2-a9bd-f1e26407c2d5 tempest-ProjectMemberTests-2016434849 None] snapshot_file for this snap is: volume-5a83051f-5f4e-492e-a576-1e608763f5c1.bc58b2a2-bc91-4803-a92a-7c7593ec6f68 {{(pid=87046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 28 18:32:11 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[de75005d-60ad-41a1-bae4-ba322d7f37c1]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:32:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4f4e75fb-3007-45a2-a9bd-f1e26407c2d5 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.bc58b2a2-bc91-4803-a92a-7c7593ec6f68 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:11 devstack sudo[109849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.bc58b2a2-bc91-4803-a92a-7c7593ec6f68
Sep 28 18:32:11 devstack sudo[109849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:11 devstack sudo[109849]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4f4e75fb-3007-45a2-a9bd-f1e26407c2d5 tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.bc58b2a2-bc91-4803-a92a-7c7593ec6f68" returned: 0 in 0.380s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:11 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.remotefs [None req-4f4e75fb-3007-45a2-a9bd-f1e26407c2d5 tempest-ProjectMemberTests-2016434849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a83051f-5f4e-492e-a576-1e608763f5c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 28 18:32:11 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2bf77e-2b25-41cc-9c79-a2120778a0be]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:32:11 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4f4e75fb-3007-45a2-a9bd-f1e26407c2d5 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:11 devstack sudo[109854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1
Sep 28 18:32:11 devstack sudo[109854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:12 devstack sudo[109854]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4f4e75fb-3007-45a2-a9bd-f1e26407c2d5 tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1" returned: 0 in 0.366s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4f4e75fb-3007-45a2-a9bd-f1e26407c2d5 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.bc58b2a2-bc91-4803-a92a-7c7593ec6f68 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:12 devstack sudo[109859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.bc58b2a2-bc91-4803-a92a-7c7593ec6f68
Sep 28 18:32:12 devstack sudo[109859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:12 devstack sudo[109859]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4f4e75fb-3007-45a2-a9bd-f1e26407c2d5 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.bc58b2a2-bc91-4803-a92a-7c7593ec6f68" returned: 0 in 0.354s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4f4e75fb-3007-45a2-a9bd-f1e26407c2d5 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.bc58b2a2-bc91-4803-a92a-7c7593ec6f68 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:12 devstack sudo[109864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.bc58b2a2-bc91-4803-a92a-7c7593ec6f68
Sep 28 18:32:12 devstack sudo[109864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:12 devstack sudo[109864]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:12 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-4f4e75fb-3007-45a2-a9bd-f1e26407c2d5 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1.bc58b2a2-bc91-4803-a92a-7c7593ec6f68" returned: 0 in 0.252s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:12 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4f4e75fb-3007-45a2-a9bd-f1e26407c2d5 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-bc58b2a2-bc91-4803-a92a-7c7593ec6f68" released by "_delete_snapshot" :: held 1.463s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:32:12 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4f4e75fb-3007-45a2-a9bd-f1e26407c2d5 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-5a83051f-5f4e-492e-a576-1e608763f5c1" released by "delete_snapshot" :: held 1.489s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:32:12 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-4f4e75fb-3007-45a2-a9bd-f1e26407c2d5 tempest-ProjectMemberTests-2016434849 None] Created reservations ['edfd323d-e6e3-4d84-a369-a8fa2f6a6f76', 'dbeb2f78-4df8-4947-8373-053e5330f8cb', '538eb59e-b2d5-4963-b016-3e3f0dadb5b0', 'ad936fbe-fadd-4c4a-a5f5-0b63ac3fe5b1'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:32:12 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-4f4e75fb-3007-45a2-a9bd-f1e26407c2d5 tempest-ProjectMemberTests-2016434849 None] Delete snapshot completed successfully.
Sep 28 18:32:12 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-4f4e75fb-3007-45a2-a9bd-f1e26407c2d5 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-bc58b2a2-bc91-4803-a92a-7c7593ec6f68-delete_snapshot" released by "delete_snapshot" :: held 1.639s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:32:13 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-27c02fd4-f916-4830-a2f0-1ff1d25445f1 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-5a83051f-5f4e-492e-a576-1e608763f5c1-delete_volume" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:32:13 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-27c02fd4-f916-4830-a2f0-1ff1d25445f1 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-5a83051f-5f4e-492e-a576-1e608763f5c1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:32:13 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-27c02fd4-f916-4830-a2f0-1ff1d25445f1 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "cinder-quobyte-5a83051f-5f4e-492e-a576-1e608763f5c1" by "delete_volume" {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 28 18:32:13 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-27c02fd4-f916-4830-a2f0-1ff1d25445f1 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-5a83051f-5f4e-492e-a576-1e608763f5c1" acquired by "delete_volume" :: waited 0.014s {{(pid=87046) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 28 18:32:13 devstack cinder-volume[87046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd01b89b-1e70-4daf-94e0-c423dac70abd]: (4, 'qcow2') {{(pid=88559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 28 18:32:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-27c02fd4-f916-4830-a2f0-1ff1d25445f1 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:13 devstack sudo[109868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1
Sep 28 18:32:13 devstack sudo[109868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:13 devstack sudo[109868]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-27c02fd4-f916-4830-a2f0-1ff1d25445f1 tempest-ProjectMemberTests-2016434849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1" returned: 0 in 0.359s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:13 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-27c02fd4-f916-4830-a2f0-1ff1d25445f1 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1 {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:13 devstack sudo[109873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1
Sep 28 18:32:13 devstack sudo[109873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:14 devstack sudo[109873]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-27c02fd4-f916-4830-a2f0-1ff1d25445f1 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae/volume-5a83051f-5f4e-492e-a576-1e608763f5c1" returned: 0 in 0.253s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:14 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-27c02fd4-f916-4830-a2f0-1ff1d25445f1 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-quobyte-5a83051f-5f4e-492e-a576-1e608763f5c1" released by "delete_volume" :: held 0.668s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:32:14 devstack cinder-volume[87046]: DEBUG cinder.quota [None req-27c02fd4-f916-4830-a2f0-1ff1d25445f1 tempest-ProjectMemberTests-2016434849 None] Created reservations ['fb684487-7147-425c-bad2-613ac4e77960', '9488d91f-be11-46dc-8024-e11533f7f731', '04318dbc-da8e-4ddf-8e99-b24aaf95a0d3', 'beef182a-f95c-4f50-bdca-8be5666379d8'] {{(pid=87046) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 28 18:32:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-27c02fd4-f916-4830-a2f0-1ff1d25445f1 tempest-ProjectMemberTests-2016434849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:32:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-27c02fd4-f916-4830-a2f0-1ff1d25445f1 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:32:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-27c02fd4-f916-4830-a2f0-1ff1d25445f1 tempest-ProjectMemberTests-2016434849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:32:14 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-27c02fd4-f916-4830-a2f0-1ff1d25445f1 tempest-ProjectMemberTests-2016434849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:32:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-27c02fd4-f916-4830-a2f0-1ff1d25445f1 tempest-ProjectMemberTests-2016434849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:32:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-27c02fd4-f916-4830-a2f0-1ff1d25445f1 tempest-ProjectMemberTests-2016434849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:14 devstack sudo[109876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:32:14 devstack sudo[109876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:14 devstack sudo[109876]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:14 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-27c02fd4-f916-4830-a2f0-1ff1d25445f1 tempest-ProjectMemberTests-2016434849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.266s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:14 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-27c02fd4-f916-4830-a2f0-1ff1d25445f1 tempest-ProjectMemberTests-2016434849 None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:32:14 devstack cinder-volume[87046]: INFO cinder.volume.manager [None req-27c02fd4-f916-4830-a2f0-1ff1d25445f1 tempest-ProjectMemberTests-2016434849 None] Deleted volume successfully.
Sep 28 18:32:14 devstack cinder-volume[87046]: DEBUG cinder.coordination [None req-27c02fd4-f916-4830-a2f0-1ff1d25445f1 tempest-ProjectMemberTests-2016434849 None] Lock "cinder-5a83051f-5f4e-492e-a576-1e608763f5c1-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=87046) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 28 18:32:24 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:INSERT=47,cinder:UPDATE=184,cinder:SELECT=146,cinder:DELETE=10 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:32:24 devstack cinder-volume[87046]: DEBUG dbcounter [-] [87046] Writing DB stats cinder:SELECT=125,cinder:INSERT=54,cinder:UPDATE=175,cinder:DELETE=18 {{(pid=87046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 28 18:32:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:32:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 28 18:32:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 28 18:32:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898': None} {{(pid=87046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 28 18:32:39 devstack cinder-volume[87046]: DEBUG cinder.volume.drivers.quobyte [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-161fe415-8bbc-4704-a33c-3b585ddba898'] {{(pid=87046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 28 18:32:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.lockutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 28 18:32:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 28 18:32:39 devstack sudo[109927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae
Sep 28 18:32:39 devstack sudo[109927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 28 18:32:39 devstack sudo[109927]: pam_unix(sudo:session): session closed for user root
Sep 28 18:32:39 devstack cinder-volume[87046]: DEBUG oslo_concurrency.processutils [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a94a67ec296736f8651ddf6577078fae" returned: 0 in 0.235s {{(pid=87046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 28 18:32:39 devstack cinder-volume[87046]: DEBUG cinder.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Notifying Schedulers of capabilities ... {{(pid=87046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 28 18:32:39 devstack cinder-volume[87046]: DEBUG oslo_service.periodic_task [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] Running periodic task VolumeManager._thread_info {{(pid=87046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 28 18:32:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread count: 28 {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 28 18:32:39 devstack cinder-volume[87046]: DEBUG cinder.volume.manager [None req-d068d862-7500-4e09-8170-3c281a52bc2b None None] thread info: [<_MainThread(MainThread, started 134598741495936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134598629708352)>, <Thread(Thread-3 (stat_writer), started daemon 134598629387584)>, <Thread(Rabbit-heartbeat, started daemon 134598627017664)>, <Thread(Thread-5 (_runner), started daemon 134598627100800)>, <Thread(Thread-7 (_runner), started daemon 134598627217536)>, <Thread(fd_logger, started daemon 134598625092480)>, <Thread(privsep_reader, started daemon 134598620930496)>, <Thread(tpool_thread_0, started daemon 134598617708224)>, <Thread(tpool_thread_1, started daemon 134598609315520)>, <Thread(tpool_thread_2, started daemon 134598600922816)>, <Thread(tpool_thread_3, started daemon 134598592530112)>, <Thread(tpool_thread_4, started daemon 134598584137408)>, <Thread(tpool_thread_5, started daemon 134598575744704)>, <Thread(tpool_thread_6, started daemon 134598567335616)>, <Thread(tpool_thread_7, started daemon 134598558926528)>, <Thread(tpool_thread_8, started daemon 134598550517440)>, <Thread(tpool_thread_9, started daemon 134598542108352)>, <Thread(tpool_thread_10, started daemon 134598533699264)>, <Thread(tpool_thread_11, started daemon 134598525290176)>, <Thread(tpool_thread_12, started daemon 134598516881088)>, <Thread(tpool_thread_13, started daemon 134598508472000)>, <Thread(tpool_thread_14, started daemon 134598500062912)>, <Thread(tpool_thread_15, started daemon 134598491653824)>, <Thread(tpool_thread_16, started daemon 134598483244736)>, <Thread(tpool_thread_17, started daemon 134598474835648)>, <Thread(tpool_thread_18, started daemon 134598466426560)>, <Thread(tpool_thread_19, started daemon 134598458017472)>] {{(pid=87046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}